2026-03-30 12:00:48 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 12:00:48 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 12:00:48 [auto1.fr] INFO: Batch mode enabled: batch 4/4
2026-03-30 12:00:48 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 12:00:48 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 12:00:48 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 12:00:48 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 12:00:48 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 12:00:48 [scrapy.extensions.telnet] INFO: Telnet Password: e024bcbdc7ca7de0
2026-03-30 12:00:48 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 12:00:48 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_14_2026-03-30T11_15_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 12:00:48 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:00:48 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:00:48 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 12:00:48 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 12:00:48 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 12:00:48 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 12:00:48 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 12:00:48 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 12:00:48 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 12:00:48 [scrapy.core.engine] INFO: Spider opened
2026-03-30 12:00:48 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:00:48 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 12:00:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 12:00:48 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:00:48 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 12:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 12:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 12:01:15 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:15 [auto1.fr] INFO: Found listing with ID: WH48728
2026-03-30 12:01:15 [auto1.fr] INFO: Found listing with ID: PX67589
2026-03-30 12:01:15 [auto1.fr] INFO: Found listing with ID: RT17990
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT17990%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [auto1.fr] INFO: Scrape type for RT17990: 2
2026-03-30 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a813e932-d020-5607-831c-a20cff1c6f7e with identifier: RT17990
2026-03-30 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a813e932-d020-5607-831c-a20cff1c6f7e with scrape type 2
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a813e932-d020-5607-831c-a20cff1c6f7e with scrape type 2
2026-03-30 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a813e932-d020-5607-831c-a20cff1c6f7e, identifier: RT17990
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a813e932-d020-5607-831c-a20cff1c6f7e with identifier: RT17990
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a813e932-d020-5607-831c-a20cff1c6f7e with identifier: RT17990
2026-03-30 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a813e932-d020-5607-831c-a20cff1c6f7e with identifier: RT17990 to the API
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:36:51Z',
'fuel_type': 'petrol',
'id': 'a813e932-d020-5607-831c-a20cff1c6f7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT17990',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 66850,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-20',
'seller_name': None,
'title': 'Renault Clio 1.2 Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2016}
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT17990%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [auto1.fr] INFO: Saving data for RT17990: {'auction_closing_time': 1774971411.0, 'created_time': 1774299789.814428, 'last_price_update_time': 1774872076.673382}
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RT17990') HTTP/1.1" 204 0
2026-03-30 12:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:16 [auto1.fr] INFO: Found listing with ID: YA42732
2026-03-30 12:01:16 [auto1.fr] INFO: Found listing with ID: MF38418
2026-03-30 12:01:16 [auto1.fr] INFO: Found listing with ID: UD80971
2026-03-30 12:01:16 [auto1.fr] INFO: Found listing with ID: YX78914
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX78914%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [auto1.fr] INFO: Scrape type for YX78914: 2
2026-03-30 12:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44e1edd-9a40-5e60-b23b-e2a9ce755540 with identifier: YX78914
2026-03-30 12:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44e1edd-9a40-5e60-b23b-e2a9ce755540 with scrape type 2
2026-03-30 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a44e1edd-9a40-5e60-b23b-e2a9ce755540 with scrape type 2
2026-03-30 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a44e1edd-9a40-5e60-b23b-e2a9ce755540, identifier: YX78914
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a44e1edd-9a40-5e60-b23b-e2a9ce755540 with identifier: YX78914
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a44e1edd-9a40-5e60-b23b-e2a9ce755540 with identifier: YX78914
2026-03-30 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a44e1edd-9a40-5e60-b23b-e2a9ce755540 with identifier: YX78914 to the API
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:44:33Z',
'fuel_type': 'diesel',
'id': 'a44e1edd-9a40-5e60-b23b-e2a9ce755540',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX78914',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 185649,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seller_name': None,
'title': 'Opel Mokka X 1.6 CDTI Elite Start/Stop',
'transmission': 'manual',
'trim': 'Elite Start/Stop',
'year': 2016}
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX78914%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.fr] INFO: Saving data for YX78914: {'auction_closing_time': 1774971873.0, 'created_time': 1773692553.551053, 'last_price_update_time': 1774872077.44373}
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YX78914') HTTP/1.1" 204 0
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: UD19750
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: PD11566
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: BS94858
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: UD89538
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: PX32662
2026-03-30 12:01:17 [auto1.fr] INFO: Found listing with ID: KM23082
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM23082%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.fr] INFO: Scrape type for KM23082: 2
2026-03-30 12:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with identifier: KM23082
2026-03-30 12:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with scrape type 2
2026-03-30 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with scrape type 2
2026-03-30 12:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2, identifier: KM23082
2026-03-30 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with identifier: KM23082
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with identifier: KM23082
2026-03-30 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17a3cb7c-8e4b-5101-a4ec-df08a4d552f2 with identifier: KM23082 to the API
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:16:48Z',
'fuel_type': 'petrol',
'id': '17a3cb7c-8e4b-5101-a4ec-df08a4d552f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM23082',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 110870,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-03',
'seller_name': None,
'title': 'MINI One First',
'transmission': 'manual',
'trim': 'First',
'year': 2015}
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM23082%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Saving data for KM23082: {'auction_closing_time': 1774970208.0, 'created_time': 1773666105.135165, 'last_price_update_time': 1774872078.072786}
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KM23082') HTTP/1.1" 204 0
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: UY58447
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: CB37386
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB37386%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Scrape type for CB37386: 1
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: MM08238
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM08238%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Scrape type for MM08238: 2
2026-03-30 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98144fad-3193-5bdb-95cb-188c395f42c9 with identifier: MM08238
2026-03-30 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98144fad-3193-5bdb-95cb-188c395f42c9 with scrape type 2
2026-03-30 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98144fad-3193-5bdb-95cb-188c395f42c9 with scrape type 2
2026-03-30 12:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98144fad-3193-5bdb-95cb-188c395f42c9, identifier: MM08238
2026-03-30 12:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98144fad-3193-5bdb-95cb-188c395f42c9 with identifier: MM08238
2026-03-30 12:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98144fad-3193-5bdb-95cb-188c395f42c9 with identifier: MM08238
2026-03-30 12:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98144fad-3193-5bdb-95cb-188c395f42c9 with identifier: MM08238 to the API
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:33:46Z',
'fuel_type': 'petrol',
'id': '98144fad-3193-5bdb-95cb-188c395f42c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM08238',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 21595,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-14',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe SL 10 Ans 4x2',
'transmission': 'manual',
'trim': 'SL 10 Ans 4x2',
'year': 2015}
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM08238%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Saving data for MM08238: {'auction_closing_time': 1774971226.0, 'created_time': 1772612553.386734, 'last_price_update_time': 1774872078.724575}
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MM08238') HTTP/1.1" 204 0
2026-03-30 12:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: XV65700
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV65700%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Scrape type for XV65700: 1
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: NV77157
2026-03-30 12:01:18 [auto1.fr] INFO: Found listing with ID: EE45215
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45215%27 HTTP/1.1" 200 None
2026-03-30 12:01:18 [auto1.fr] INFO: Scrape type for EE45215: 2
2026-03-30 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab19391-d7a8-5e8d-a9db-078c76d36290 with identifier: EE45215
2026-03-30 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab19391-d7a8-5e8d-a9db-078c76d36290 with scrape type 2
2026-03-30 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab19391-d7a8-5e8d-a9db-078c76d36290 with scrape type 2
2026-03-30 12:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cab19391-d7a8-5e8d-a9db-078c76d36290, identifier: EE45215
2026-03-30 12:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cab19391-d7a8-5e8d-a9db-078c76d36290 with identifier: EE45215
2026-03-30 12:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cab19391-d7a8-5e8d-a9db-078c76d36290 with identifier: EE45215
2026-03-30 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cab19391-d7a8-5e8d-a9db-078c76d36290 with identifier: EE45215 to the API
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:19:50Z',
'fuel_type': 'diesel',
'id': 'cab19391-d7a8-5e8d-a9db-078c76d36290',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE45215',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 205339,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Citroen C4 1.6 e-HDi Millenium',
'transmission': 'manual',
'trim': 'Millenium',
'year': 2013}
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45215%27 HTTP/1.1" 200 None
2026-03-30 12:01:19 [auto1.fr] INFO: Saving data for EE45215: {'auction_closing_time': 1774970390.0, 'created_time': 1774269718.822423, 'last_price_update_time': 1774872079.250043}
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE45215') HTTP/1.1" 204 0
2026-03-30 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:19 [auto1.fr] INFO: Found listing with ID: MH48249
2026-03-30 12:01:19 [auto1.fr] INFO: Found listing with ID: JV73062
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV73062%27 HTTP/1.1" 200 None
2026-03-30 12:01:19 [auto1.fr] INFO: Scrape type for JV73062: 2
2026-03-30 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e869e7f-fab4-5ae9-954f-f7b08b776399 with identifier: JV73062
2026-03-30 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e869e7f-fab4-5ae9-954f-f7b08b776399 with scrape type 2
2026-03-30 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e869e7f-fab4-5ae9-954f-f7b08b776399 with scrape type 2
2026-03-30 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e869e7f-fab4-5ae9-954f-f7b08b776399, identifier: JV73062
2026-03-30 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e869e7f-fab4-5ae9-954f-f7b08b776399 with identifier: JV73062
2026-03-30 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e869e7f-fab4-5ae9-954f-f7b08b776399 with identifier: JV73062
2026-03-30 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e869e7f-fab4-5ae9-954f-f7b08b776399 with identifier: JV73062 to the API
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:01:06Z',
'fuel_type': 'diesel',
'id': '2e869e7f-fab4-5ae9-954f-f7b08b776399',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV73062',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 218761,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-25',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Trendline',
'transmission': 'automatic',
'trim': 'Trendline',
'year': 2008}
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV73062%27 HTTP/1.1" 200 None
2026-03-30 12:01:19 [auto1.fr] INFO: Saving data for JV73062: {'auction_closing_time': 1774969266.0, 'created_time': 1773252663.560641, 'last_price_update_time': 1774872079.950928}
2026-03-30 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV73062') HTTP/1.1" 204 0
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: DV39101
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV39101%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Scrape type for DV39101: 1
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: GG18860
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG18860%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Scrape type for GG18860: 1
2026-03-30 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: VT14934
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: HP90733
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: GN63386
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: CF56916
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: CS41270
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: XB55428
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB55428%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Scrape type for XB55428: 1
2026-03-30 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: KX25822
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: HN35098
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: JZ08027
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: YU99322
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: UY44402
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: BE59418
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: TT82672
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: YB17144
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: KM22406
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM22406%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Scrape type for KM22406: 2
2026-03-30 12:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9bec29-cd79-547c-87fa-819bb559b6df with identifier: KM22406
2026-03-30 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9bec29-cd79-547c-87fa-819bb559b6df with scrape type 2
2026-03-30 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f9bec29-cd79-547c-87fa-819bb559b6df with scrape type 2
2026-03-30 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f9bec29-cd79-547c-87fa-819bb559b6df, identifier: KM22406
2026-03-30 12:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f9bec29-cd79-547c-87fa-819bb559b6df with identifier: KM22406
2026-03-30 12:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f9bec29-cd79-547c-87fa-819bb559b6df with identifier: KM22406
2026-03-30 12:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3f9bec29-cd79-547c-87fa-819bb559b6df with identifier: KM22406 to the API
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:49:21Z',
'fuel_type': 'petrol',
'id': '3f9bec29-cd79-547c-87fa-819bb559b6df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM22406',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 141258,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Allstar',
'transmission': 'manual',
'trim': 'Allstar',
'year': 2017}
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM22406%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Saving data for KM22406: {'auction_closing_time': 1774972161.0, 'created_time': 1772214408.983968, 'last_price_update_time': 1774872080.752957}
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KM22406') HTTP/1.1" 204 0
2026-03-30 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: VA21419
2026-03-30 12:01:20 [auto1.fr] INFO: Found listing with ID: UA52585
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52585%27 HTTP/1.1" 200 None
2026-03-30 12:01:20 [auto1.fr] INFO: Scrape type for UA52585: 1
2026-03-30 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB37386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:24 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: WH48728
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: PX67589
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: RT17990
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT17990%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for RT17990: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: YA42732
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: MF38418
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UD80971
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: YX78914
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX78914%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for YX78914: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UD19750
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: PD11566
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: BS94858
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UD89538
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: PX32662
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: KM23082
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM23082%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for KM23082: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UY58447
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: CB37386
2026-03-30 12:01:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/CB37386/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: MM08238
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM08238%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for MM08238: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: XV65700
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: NV77157
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: EE45215
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45215%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for EE45215: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: MH48249
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: JV73062
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV73062%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for JV73062: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: DV39101
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: GG18860
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: VT14934
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: HP90733
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: GN63386
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: CF56916
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: CS41270
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: XB55428
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: KX25822
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: HN35098
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: JZ08027
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: YU99322
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UY44402
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: BE59418
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: TT82672
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: YB17144
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: KM22406
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM22406%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for KM22406: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: VA21419
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: UA52585
2026-03-30 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV65700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:33 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 5687 | hits on page: 40
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: VA21419
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: UA52585
2026-03-30 12:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: DN00368
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN00368%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for DN00368: 1
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: KV64764
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV64764%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for KV64764: 1
2026-03-30 12:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: FA77085
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: GM72216
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM72216%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for GM72216: 2
2026-03-30 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cad838-f012-579b-952d-8ce066ef63fd with identifier: GM72216
2026-03-30 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cad838-f012-579b-952d-8ce066ef63fd with scrape type 2
2026-03-30 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cad838-f012-579b-952d-8ce066ef63fd with scrape type 2
2026-03-30 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9cad838-f012-579b-952d-8ce066ef63fd, identifier: GM72216
2026-03-30 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9cad838-f012-579b-952d-8ce066ef63fd with identifier: GM72216
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9cad838-f012-579b-952d-8ce066ef63fd with identifier: GM72216
2026-03-30 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9cad838-f012-579b-952d-8ce066ef63fd with identifier: GM72216 to the API
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:38:31Z',
'fuel_type': 'diesel',
'id': 'c9cad838-f012-579b-952d-8ce066ef63fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM72216',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 212400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-04',
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM72216%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Saving data for GM72216: {'auction_closing_time': 1774971511.0, 'created_time': 1774299835.791442, 'last_price_update_time': 1774872094.55224}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM72216') HTTP/1.1" 204 0
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: NJ73024
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: PB73198
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: JU43458
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU43458%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Scrape type for JU43458: 1
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: WV43815
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: NP11581
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: RX18244
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: VK19723
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: LW71513
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: UY27406
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: GG75036
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: VJ94482
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: LM69202
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: GR68015
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: MZ47955
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: LR41287
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: DB07051
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB07051%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Scrape type for DB07051: 2
2026-03-30 12:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with identifier: DB07051
2026-03-30 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with scrape type 2
2026-03-30 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with scrape type 2
2026-03-30 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6, identifier: DB07051
2026-03-30 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with identifier: DB07051
2026-03-30 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with identifier: DB07051
2026-03-30 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0040bed0-60cd-55ab-903e-1f4b0ecf6cb6 with identifier: DB07051 to the API
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:24:43Z',
'fuel_type': 'diesel',
'id': '0040bed0-60cd-55ab-903e-1f4b0ecf6cb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB07051',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 270513,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-03',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
'transmission': 'manual',
'trim': 'Intensive',
'year': 2014}
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB07051%27 HTTP/1.1" 200 None
2026-03-30 12:01:35 [auto1.fr] INFO: Saving data for DB07051: {'auction_closing_time': 1774970683.0, 'created_time': 1772212347.912941, 'last_price_update_time': 1774872095.769788}
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB07051') HTTP/1.1" 204 0
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: BJ74414
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ74414%27 HTTP/1.1" 200 None
2026-03-30 12:01:35 [auto1.fr] INFO: Scrape type for BJ74414: 1
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: AT75907
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT75907%27 HTTP/1.1" 200 None
2026-03-30 12:01:35 [auto1.fr] INFO: Scrape type for AT75907: 1
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: MG77524
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: FY00408
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: PR62918
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: SD54600
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD54600%27 HTTP/1.1" 200 None
2026-03-30 12:01:35 [auto1.fr] INFO: Scrape type for SD54600: 1
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: TY98039
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: HW61019
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: ZN19344
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: NY07201
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: VX26854
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX26854%27 HTTP/1.1" 200 None
2026-03-30 12:01:35 [auto1.fr] INFO: Scrape type for VX26854: 1
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: PN57067
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: YZ78520
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: SC42808
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: GM24607
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: BU38930
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: UN25144
2026-03-30 12:01:35 [auto1.fr] INFO: Found listing with ID: EF08493
2026-03-30 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV65700> (referer: https://www.auto1.com/v1/car-details-view/XV65700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead3c092-c7fc-5f9d-a8df-5f0023857845 with identifier: XV65700
2026-03-30 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead3c092-c7fc-5f9d-a8df-5f0023857845 with scrape type 1
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ead3c092-c7fc-5f9d-a8df-5f0023857845
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_0d12e7b1ea75856b88c691237ee545b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_0d12e7b1ea75856b88c691237ee545b9.jpg already downloaded
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_2195fa9094abf20743c8c96221a28427.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_2195fa9094abf20743c8c96221a28427.jpg already downloaded
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_57f0c524f20616e3b288c6f933ec9f9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_57f0c524f20616e3b288c6f933ec9f9f.jpg already downloaded
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_11eb7814fc85d518e1e8263af51afddb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_11eb7814fc85d518e1e8263af51afddb.jpg already downloaded
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_687caf04cb3add931191e715f586b1b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_687caf04cb3add931191e715f586b1b5.jpg already downloaded
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Feb%252Ffceb1ab9c8d9b6cd6cfe4a1747b9859d%252Fpa%252FXV65700_1dae2e90db10fa3f0f3f21735e18a105.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_1dae2e90db10fa3f0f3f21735e18a105.jpg already downloaded
2026-03-30 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ead3c092-c7fc-5f9d-a8df-5f0023857845, identifier: XV65700
2026-03-30 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ead3c092-c7fc-5f9d-a8df-5f0023857845 with identifier: XV65700
2026-03-30 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ead3c092-c7fc-5f9d-a8df-5f0023857845 with identifier: XV65700
2026-03-30 12:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ead3c092-c7fc-5f9d-a8df-5f0023857845 with identifier: XV65700 to the API
2026-03-30 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV65700>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:18:59Z',
'fuel_type': 'diesel',
'id': 'ead3c092-c7fc-5f9d-a8df-5f0023857845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV65700',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 240680,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_0d12e7b1ea75856b88c691237ee545b9.jpg',
'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_2195fa9094abf20743c8c96221a28427.jpg',
'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_57f0c524f20616e3b288c6f933ec9f9f.jpg',
'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_11eb7814fc85d518e1e8263af51afddb.jpg',
'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_687caf04cb3add931191e715f586b1b5.jpg',
'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_1dae2e90db10fa3f0f3f21735e18a105.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_0d12e7b1ea75856b88c691237ee545b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_2195fa9094abf20743c8c96221a28427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_57f0c524f20616e3b288c6f933ec9f9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_11eb7814fc85d518e1e8263af51afddb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_687caf04cb3add931191e715f586b1b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3c092-c7fc-5f9d-a8df-5f0023857845/ead3c092-c7fc-5f9d-a8df-5f0023857845_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/eb/fceb1ab9c8d9b6cd6cfe4a1747b9859d/pa/XV65700_1dae2e90db10fa3f0f3f21735e18a105.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2010}
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV65700%27 HTTP/1.1" 200 None
2026-03-30 12:01:41 [auto1.fr] INFO: Saving data for XV65700: {'created_time': 1774872101.059191, 'last_price_update_time': 1774872101.059203, 'auction_closing_time': 1774970339.0}
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XV65700') HTTP/1.1" 204 0
2026-03-30 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:41 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 5687 | hits on page: 40
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: HL55412
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: ZV36898
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: BU59863
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: JM33672
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: JU85773
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: LF30369
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF30369%27 HTTP/1.1" 200 None
2026-03-30 12:01:41 [auto1.fr] INFO: Scrape type for LF30369: 2
2026-03-30 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261767b4-fa3d-511f-94a0-e967dd2c0a3f with identifier: LF30369
2026-03-30 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261767b4-fa3d-511f-94a0-e967dd2c0a3f with scrape type 2
2026-03-30 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261767b4-fa3d-511f-94a0-e967dd2c0a3f with scrape type 2
2026-03-30 12:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 261767b4-fa3d-511f-94a0-e967dd2c0a3f, identifier: LF30369
2026-03-30 12:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 261767b4-fa3d-511f-94a0-e967dd2c0a3f with identifier: LF30369
2026-03-30 12:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 261767b4-fa3d-511f-94a0-e967dd2c0a3f with identifier: LF30369
2026-03-30 12:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 261767b4-fa3d-511f-94a0-e967dd2c0a3f with identifier: LF30369 to the API
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:08:45Z',
'fuel_type': 'diesel',
'id': '261767b4-fa3d-511f-94a0-e967dd2c0a3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF30369',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 189026,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-17',
'seller_name': None,
'title': 'Volvo XC40 2.0 D4 First Edition AWD',
'transmission': 'automatic',
'trim': 'First Edition AWD',
'year': 2018}
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF30369%27 HTTP/1.1" 200 None
2026-03-30 12:01:41 [auto1.fr] INFO: Saving data for LF30369: {'auction_closing_time': 1774969725.0, 'created_time': 1774269660.388049, 'last_price_update_time': 1774872101.72428}
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF30369') HTTP/1.1" 204 0
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: CB66110
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: WG48740
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: KS78831
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: LU19709
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: UY99248
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: FP86995
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: EJ67519
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: YE22009
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: TR82723
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: XR62682
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: VE95693
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: UY95112
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY95112%27 HTTP/1.1" 200 None
2026-03-30 12:01:41 [auto1.fr] INFO: Scrape type for UY95112: 1
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: CJ43665
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: PS01838
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: GC33041
2026-03-30 12:01:41 [auto1.fr] INFO: Found listing with ID: HF19797
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF19797%27 HTTP/1.1" 200 None
2026-03-30 12:01:41 [auto1.fr] INFO: Scrape type for HF19797: 2
2026-03-30 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with identifier: HF19797
2026-03-30 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with scrape type 2
2026-03-30 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with scrape type 2
2026-03-30 12:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d61d188-1ebf-56fb-b3ce-d13bb6352bee, identifier: HF19797
2026-03-30 12:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with identifier: HF19797
2026-03-30 12:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with identifier: HF19797
2026-03-30 12:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d61d188-1ebf-56fb-b3ce-d13bb6352bee with identifier: HF19797 to the API
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:11:51Z',
'fuel_type': 'diesel',
'id': '3d61d188-1ebf-56fb-b3ce-d13bb6352bee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF19797',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 160462,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline Business BlueMotion',
'transmission': 'manual',
'trim': 'Trendline Business BlueMotion',
'year': 2017}
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF19797%27 HTTP/1.1" 200 None
2026-03-30 12:01:42 [auto1.fr] INFO: Saving data for HF19797: {'auction_closing_time': 1774969911.0, 'created_time': 1774268548.480273, 'last_price_update_time': 1774872102.266718}
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HF19797') HTTP/1.1" 204 0
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: EW48077
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: DP87116
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: CJ65554
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: WM44458
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: US82049
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: FU59692
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU59692%27 HTTP/1.1" 200 None
2026-03-30 12:01:42 [auto1.fr] INFO: Scrape type for FU59692: 2
2026-03-30 12:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a399a772-df17-5b9f-bfa2-423b44748666 with identifier: FU59692
2026-03-30 12:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a399a772-df17-5b9f-bfa2-423b44748666 with scrape type 2
2026-03-30 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a399a772-df17-5b9f-bfa2-423b44748666 with scrape type 2
2026-03-30 12:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a399a772-df17-5b9f-bfa2-423b44748666, identifier: FU59692
2026-03-30 12:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a399a772-df17-5b9f-bfa2-423b44748666 with identifier: FU59692
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 12:01:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a399a772-df17-5b9f-bfa2-423b44748666 with identifier: FU59692
2026-03-30 12:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a399a772-df17-5b9f-bfa2-423b44748666 with identifier: FU59692 to the API
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:38:19Z',
'fuel_type': 'diesel',
'id': 'a399a772-df17-5b9f-bfa2-423b44748666',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU59692',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 283285,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-17',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU59692%27 HTTP/1.1" 200 None
2026-03-30 12:01:42 [auto1.fr] INFO: Saving data for FU59692: {'auction_closing_time': 1774971499.0, 'created_time': 1774269504.306735, 'last_price_update_time': 1774872102.942929}
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FU59692') HTTP/1.1" 204 0
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: BF40383
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: KH83652
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH83652%27 HTTP/1.1" 200 None
2026-03-30 12:01:42 [auto1.fr] INFO: Scrape type for KH83652: 1
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: GT82965
2026-03-30 12:01:42 [auto1.fr] INFO: Found listing with ID: PY37757
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY37757%27 HTTP/1.1" 200 None
2026-03-30 12:01:42 [auto1.fr] INFO: Scrape type for PY37757: 2
2026-03-30 12:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55cae846-13b8-57fa-8aa7-47456a970ea6 with identifier: PY37757
2026-03-30 12:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55cae846-13b8-57fa-8aa7-47456a970ea6 with scrape type 2
2026-03-30 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55cae846-13b8-57fa-8aa7-47456a970ea6 with scrape type 2
2026-03-30 12:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 55cae846-13b8-57fa-8aa7-47456a970ea6, identifier: PY37757
2026-03-30 12:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 55cae846-13b8-57fa-8aa7-47456a970ea6 with identifier: PY37757
2026-03-30 12:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 55cae846-13b8-57fa-8aa7-47456a970ea6 with identifier: PY37757
2026-03-30 12:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 55cae846-13b8-57fa-8aa7-47456a970ea6 with identifier: PY37757 to the API
2026-03-30 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:14:37Z',
'fuel_type': 'petrol',
'id': '55cae846-13b8-57fa-8aa7-47456a970ea6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY37757',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 125888,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-28',
'seller_name': None,
'title': 'Fiat Tipo 1.4 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY37757%27 HTTP/1.1" 200 None
2026-03-30 12:01:44 [auto1.fr] INFO: Saving data for PY37757: {'auction_closing_time': 1774970077.0, 'created_time': 1774253744.85331, 'last_price_update_time': 1774872104.964947}
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY37757') HTTP/1.1" 204 0
2026-03-30 12:01:44 [auto1.fr] INFO: Found listing with ID: WJ68897
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ68897%27 HTTP/1.1" 200 None
2026-03-30 12:01:44 [auto1.fr] INFO: Scrape type for WJ68897: 1
2026-03-30 12:01:44 [auto1.fr] INFO: Found listing with ID: AE60710
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: MS31119
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: SY02908
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: WL46788
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: TR38614
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: PX84872
2026-03-30 12:01:45 [auto1.fr] INFO: Found listing with ID: KF83759
2026-03-30 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU43458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:48 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 11 pages/min), scraped 14 items (at 14 items/min)
2026-03-30 12:01:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV39101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG18860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB55428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX26854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ74414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT75907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:17 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: TR38614
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: PX84872
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: KF83759
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: CD05878
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD05878%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for CD05878: 1
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: CK74331
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: GH16214
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH16214%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for GH16214: 2
2026-03-30 12:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with identifier: GH16214
2026-03-30 12:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with scrape type 2
2026-03-30 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with scrape type 2
2026-03-30 12:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba, identifier: GH16214
2026-03-30 12:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with identifier: GH16214
2026-03-30 12:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with identifier: GH16214
2026-03-30 12:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba with identifier: GH16214 to the API
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:08:05Z',
'fuel_type': 'diesel',
'id': '2d0a0ef3-dca4-5acf-a644-b7cb42e3e2ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH16214',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 194394,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-15',
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2009}
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH16214%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Saving data for GH16214: {'auction_closing_time': 1774969685.0, 'created_time': 1774268100.805358, 'last_price_update_time': 1774872138.235481}
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GH16214') HTTP/1.1" 204 0
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: NT44127
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT44127%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Scrape type for NT44127: 1
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: BT51576
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: DV54459
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: NS21275
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: YF83787
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: MH87240
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH87240%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Scrape type for MH87240: 1
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: SS47680
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS47680%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Scrape type for SS47680: 1
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: YU56432
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU56432%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Scrape type for YU56432: 2
2026-03-30 12:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5922785-7db8-584a-824a-4a4b2f69d02c with identifier: YU56432
2026-03-30 12:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5922785-7db8-584a-824a-4a4b2f69d02c with scrape type 2
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5922785-7db8-584a-824a-4a4b2f69d02c with scrape type 2
2026-03-30 12:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5922785-7db8-584a-824a-4a4b2f69d02c, identifier: YU56432
2026-03-30 12:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5922785-7db8-584a-824a-4a4b2f69d02c with identifier: YU56432
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5922785-7db8-584a-824a-4a4b2f69d02c with identifier: YU56432
2026-03-30 12:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5922785-7db8-584a-824a-4a4b2f69d02c with identifier: YU56432 to the API
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:50:03Z',
'fuel_type': 'hybrid',
'id': 'a5922785-7db8-584a-824a-4a4b2f69d02c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU56432',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 63784,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-11',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU56432%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [auto1.fr] INFO: Saving data for YU56432: {'auction_closing_time': 1774972203.0, 'created_time': 1774299845.38793, 'last_price_update_time': 1774872138.974227}
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU56432') HTTP/1.1" 204 0
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: CU45750
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: PA03861
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: XR58587
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: UH13368
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: UA69734
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: FR85071
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: SU29093
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: GJ22585
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: FV06170
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: PE02516
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: JM12134
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: PU97836
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: KV88888
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: JN92343
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: YB12408
2026-03-30 12:02:18 [auto1.fr] INFO: Found listing with ID: BG54951
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG54951%27 HTTP/1.1" 200 None
2026-03-30 12:02:19 [auto1.fr] INFO: Scrape type for BG54951: 2
2026-03-30 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with identifier: BG54951
2026-03-30 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with scrape type 2
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with scrape type 2
2026-03-30 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebbcda65-66d8-50a4-af0c-72d77d4e3ad7, identifier: BG54951
2026-03-30 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with identifier: BG54951
2026-03-30 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with identifier: BG54951
2026-03-30 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebbcda65-66d8-50a4-af0c-72d77d4e3ad7 with identifier: BG54951 to the API
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:25:54Z',
'fuel_type': 'hybrid',
'id': 'ebbcda65-66d8-50a4-af0c-72d77d4e3ad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG54951',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 129754,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'BMW 2er 225xe Active Tourer Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2018}
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG54951%27 HTTP/1.1" 200 None
2026-03-30 12:02:19 [auto1.fr] INFO: Saving data for BG54951: {'auction_closing_time': 1774970754.0, 'created_time': 1772618589.894247, 'last_price_update_time': 1774872139.612866}
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG54951') HTTP/1.1" 204 0
2026-03-30 12:02:19 [auto1.fr] INFO: Found listing with ID: MC09972
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC09972%27 HTTP/1.1" 200 None
2026-03-30 12:02:19 [auto1.fr] INFO: Scrape type for MC09972: 2
2026-03-30 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65828b97-48fd-535d-86c4-cca8610e33be with identifier: MC09972
2026-03-30 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65828b97-48fd-535d-86c4-cca8610e33be with scrape type 2
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65828b97-48fd-535d-86c4-cca8610e33be with scrape type 2
2026-03-30 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 65828b97-48fd-535d-86c4-cca8610e33be, identifier: MC09972
2026-03-30 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 65828b97-48fd-535d-86c4-cca8610e33be with identifier: MC09972
2026-03-30 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 65828b97-48fd-535d-86c4-cca8610e33be with identifier: MC09972
2026-03-30 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 65828b97-48fd-535d-86c4-cca8610e33be with identifier: MC09972 to the API
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:05:59Z',
'fuel_type': 'petrol',
'id': '65828b97-48fd-535d-86c4-cca8610e33be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC09972',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 180230,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC09972%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [auto1.fr] INFO: Saving data for MC09972: {'auction_closing_time': 1774969559.0, 'created_time': 1774080938.369003, 'last_price_update_time': 1774872140.213323}
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC09972') HTTP/1.1" 204 0
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: DP81330
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: GL09785
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: PU51122
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: YW85128
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: UK53228
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: LF01831
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF01831%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [auto1.fr] INFO: Scrape type for LF01831: 1
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: FM80198
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: HL85627
2026-03-30 12:02:20 [auto1.fr] INFO: Found listing with ID: NY25826
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ68897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH83652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA52585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY95112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG18860> (referer: https://www.auto1.com/v1/car-details-view/GG18860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a20e35-02d5-5ad0-ba7b-985c69e33717 with identifier: GG18860
2026-03-30 12:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a20e35-02d5-5ad0-ba7b-985c69e33717 with scrape type 1
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66a20e35-02d5-5ad0-ba7b-985c69e33717
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_462973939b565a3bd7f2d33fc33a9abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_462973939b565a3bd7f2d33fc33a9abe.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_220eef0151013051cb54f3ae69c8863f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_220eef0151013051cb54f3ae69c8863f.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_a2e13d68d198752892c7e97765aa5b6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a2e13d68d198752892c7e97765aa5b6a.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_459b3775e34e5fe11a1738ca4da32cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_459b3775e34e5fe11a1738ca4da32cdb.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_2d8ddee68aaa5376b27ed717705d1bb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_2d8ddee68aaa5376b27ed717705d1bb9.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_42cdec4eedfc19b975e2d48cadc523cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_42cdec4eedfc19b975e2d48cadc523cb.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_e3671b841284c4f3d4c5b0ed73bb4606.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_e3671b841284c4f3d4c5b0ed73bb4606.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_8ff030291ff9d33e05809def364eb112.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_8ff030291ff9d33e05809def364eb112.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_5af857766afd3704b208512e796ef08e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_5af857766afd3704b208512e796ef08e.jpg already downloaded
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fdb%252Fe5db113997edec2738462ee7583198b2%252Fpa%252FGG18860_a612d0f6df8d3e5ac71f9e1924141c90.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a612d0f6df8d3e5ac71f9e1924141c90.jpg already downloaded
2026-03-30 12:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66a20e35-02d5-5ad0-ba7b-985c69e33717, identifier: GG18860
2026-03-30 12:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66a20e35-02d5-5ad0-ba7b-985c69e33717 with identifier: GG18860
2026-03-30 12:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66a20e35-02d5-5ad0-ba7b-985c69e33717 with identifier: GG18860
2026-03-30 12:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66a20e35-02d5-5ad0-ba7b-985c69e33717 with identifier: GG18860 to the API
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG18860>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:07:28Z',
'fuel_type': 'petrol',
'id': '66a20e35-02d5-5ad0-ba7b-985c69e33717',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG18860',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 19828,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photo_urls': ['https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_462973939b565a3bd7f2d33fc33a9abe.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_220eef0151013051cb54f3ae69c8863f.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a2e13d68d198752892c7e97765aa5b6a.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_459b3775e34e5fe11a1738ca4da32cdb.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_2d8ddee68aaa5376b27ed717705d1bb9.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_42cdec4eedfc19b975e2d48cadc523cb.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_e3671b841284c4f3d4c5b0ed73bb4606.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_8ff030291ff9d33e05809def364eb112.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_5af857766afd3704b208512e796ef08e.jpg',
'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a612d0f6df8d3e5ac71f9e1924141c90.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_462973939b565a3bd7f2d33fc33a9abe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_220eef0151013051cb54f3ae69c8863f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a2e13d68d198752892c7e97765aa5b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_459b3775e34e5fe11a1738ca4da32cdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_2d8ddee68aaa5376b27ed717705d1bb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_42cdec4eedfc19b975e2d48cadc523cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_e3671b841284c4f3d4c5b0ed73bb4606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_8ff030291ff9d33e05809def364eb112.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_5af857766afd3704b208512e796ef08e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66a20e35-02d5-5ad0-ba7b-985c69e33717/66a20e35-02d5-5ad0-ba7b-985c69e33717_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/db/e5db113997edec2738462ee7583198b2/pa/GG18860_a612d0f6df8d3e5ac71f9e1924141c90.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG18860%27 HTTP/1.1" 200 None
2026-03-30 12:02:28 [auto1.fr] INFO: Saving data for GG18860: {'created_time': 1774872148.092032, 'last_price_update_time': 1774872148.092042, 'auction_closing_time': 1774969648.0}
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG18860') HTTP/1.1" 204 0
2026-03-30 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU43458> (referer: https://www.auto1.com/v1/car-details-view/JU43458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4ffbe4d-04f3-5766-a979-7515fa3a7356 with identifier: JU43458
2026-03-30 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ffbe4d-04f3-5766-a979-7515fa3a7356 with scrape type 1
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4ffbe4d-04f3-5766-a979-7515fa3a7356
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_0b543b943ac3ec1837d27e82901df011.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_0b543b943ac3ec1837d27e82901df011.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_3f354a6b9b238281e69c33162f202143.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_3f354a6b9b238281e69c33162f202143.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_62700beaf6672bec7ae8e94f7807b5ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_62700beaf6672bec7ae8e94f7807b5ae.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_915f0b5a4f512b1a91318e624637fa45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_915f0b5a4f512b1a91318e624637fa45.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_27862a235e1ad734e6521f7e62eb253a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_27862a235e1ad734e6521f7e62eb253a.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_aa5584e189ef3416e4b322149aed30b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_aa5584e189ef3416e4b322149aed30b0.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_ebd09ca9317aa8a459f14eea382c3f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_ebd09ca9317aa8a459f14eea382c3f3a.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_1a499ad0a54c9cd57d323864d2d93381.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_1a499ad0a54c9cd57d323864d2d93381.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_880d7f8d963085fbc8af05b6e245cbe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_880d7f8d963085fbc8af05b6e245cbe8.jpg already downloaded
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fb5%252Fe7b570e6b6e423102b210b1e23c30bf2%252Fpa%252FJU43458_17b784d9f7ac229875463f8c8e6b293e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_17b784d9f7ac229875463f8c8e6b293e.jpg already downloaded
2026-03-30 12:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4ffbe4d-04f3-5766-a979-7515fa3a7356, identifier: JU43458
2026-03-30 12:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4ffbe4d-04f3-5766-a979-7515fa3a7356 with identifier: JU43458
2026-03-30 12:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4ffbe4d-04f3-5766-a979-7515fa3a7356 with identifier: JU43458
2026-03-30 12:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4ffbe4d-04f3-5766-a979-7515fa3a7356 with identifier: JU43458 to the API
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU43458>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:27:22Z',
'fuel_type': 'diesel',
'id': 'c4ffbe4d-04f3-5766-a979-7515fa3a7356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU43458',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '308',
'odometer': 111790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_0b543b943ac3ec1837d27e82901df011.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_3f354a6b9b238281e69c33162f202143.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_62700beaf6672bec7ae8e94f7807b5ae.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_915f0b5a4f512b1a91318e624637fa45.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_27862a235e1ad734e6521f7e62eb253a.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_aa5584e189ef3416e4b322149aed30b0.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_ebd09ca9317aa8a459f14eea382c3f3a.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_1a499ad0a54c9cd57d323864d2d93381.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_880d7f8d963085fbc8af05b6e245cbe8.jpg',
'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_17b784d9f7ac229875463f8c8e6b293e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2257600,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_0b543b943ac3ec1837d27e82901df011.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2190871,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_3f354a6b9b238281e69c33162f202143.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2146967,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_62700beaf6672bec7ae8e94f7807b5ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_915f0b5a4f512b1a91318e624637fa45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_27862a235e1ad734e6521f7e62eb253a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_aa5584e189ef3416e4b322149aed30b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_ebd09ca9317aa8a459f14eea382c3f3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2101208,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_1a499ad0a54c9cd57d323864d2d93381.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2107746,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_880d7f8d963085fbc8af05b6e245cbe8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ffbe4d-04f3-5766-a979-7515fa3a7356/c4ffbe4d-04f3-5766-a979-7515fa3a7356_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/b5/e7b570e6b6e423102b210b1e23c30bf2/pa/JU43458_17b784d9f7ac229875463f8c8e6b293e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-05',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Premium Pack',
'transmission': 'manual',
'trim': 'Premium Pack',
'year': 2017}
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU43458%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [auto1.fr] INFO: Saving data for JU43458: {'created_time': 1774872157.837928, 'last_price_update_time': 1774872157.837941, 'auction_closing_time': 1774970842.0}
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU43458') HTTP/1.1" 204 0
2026-03-30 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV39101> (referer: https://www.auto1.com/v1/car-details-view/DV39101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0512f0-a6d1-5145-8d88-03a646d93c4c with identifier: DV39101
2026-03-30 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0512f0-a6d1-5145-8d88-03a646d93c4c with scrape type 1
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee0512f0-a6d1-5145-8d88-03a646d93c4c
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_6c226cede6741cc839120c9f3fa70dcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6c226cede6741cc839120c9f3fa70dcd.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_543d67657f0fe17f7a4be93f4a254364.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_543d67657f0fe17f7a4be93f4a254364.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_817071a447cc17ab5143300a0aa6fffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_817071a447cc17ab5143300a0aa6fffc.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_15a0f9d6fddda7bf522efb6bdf73994c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_15a0f9d6fddda7bf522efb6bdf73994c.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_08ea9060331e602c73f3550386c21f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_08ea9060331e602c73f3550386c21f0b.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_94f5d4c3de9113ac9ccb3a6f636efd43.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_94f5d4c3de9113ac9ccb3a6f636efd43.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_0aa065e75afd1bb17ecd8cab9dc74395.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_0aa065e75afd1bb17ecd8cab9dc74395.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_38b8854800d855bbb91182c7c5715b8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_38b8854800d855bbb91182c7c5715b8a.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_210a981499ef873d0f5ce17f2af30318.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_210a981499ef873d0f5ce17f2af30318.jpg already downloaded
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fde%252F5adecbfed058df53a5a89d4c5179769d%252Fpa%252FDV39101_6fbf44f27dbf9e6c7df9513d090db1e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6fbf44f27dbf9e6c7df9513d090db1e7.jpg already downloaded
2026-03-30 12:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee0512f0-a6d1-5145-8d88-03a646d93c4c, identifier: DV39101
2026-03-30 12:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee0512f0-a6d1-5145-8d88-03a646d93c4c with identifier: DV39101
2026-03-30 12:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee0512f0-a6d1-5145-8d88-03a646d93c4c with identifier: DV39101
2026-03-30 12:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee0512f0-a6d1-5145-8d88-03a646d93c4c with identifier: DV39101 to the API
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV39101>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:28:44Z',
'fuel_type': 'diesel',
'id': 'ee0512f0-a6d1-5145-8d88-03a646d93c4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV39101',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 165616,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6c226cede6741cc839120c9f3fa70dcd.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_543d67657f0fe17f7a4be93f4a254364.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_817071a447cc17ab5143300a0aa6fffc.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_15a0f9d6fddda7bf522efb6bdf73994c.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_08ea9060331e602c73f3550386c21f0b.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_94f5d4c3de9113ac9ccb3a6f636efd43.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_0aa065e75afd1bb17ecd8cab9dc74395.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_38b8854800d855bbb91182c7c5715b8a.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_210a981499ef873d0f5ce17f2af30318.jpg',
'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6fbf44f27dbf9e6c7df9513d090db1e7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6c226cede6741cc839120c9f3fa70dcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_543d67657f0fe17f7a4be93f4a254364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_817071a447cc17ab5143300a0aa6fffc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_15a0f9d6fddda7bf522efb6bdf73994c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_08ea9060331e602c73f3550386c21f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_94f5d4c3de9113ac9ccb3a6f636efd43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_0aa065e75afd1bb17ecd8cab9dc74395.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2615673,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_38b8854800d855bbb91182c7c5715b8a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_210a981499ef873d0f5ce17f2af30318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0512f0-a6d1-5145-8d88-03a646d93c4c/ee0512f0-a6d1-5145-8d88-03a646d93c4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/de/5adecbfed058df53a5a89d4c5179769d/pa/DV39101_6fbf44f27dbf9e6c7df9513d090db1e7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Vitara 1.6 DDiS Comfort+ 4x4',
'transmission': 'automatic',
'trim': 'Comfort+ 4x4',
'year': 2016}
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV39101%27 HTTP/1.1" 200 None
2026-03-30 12:02:38 [auto1.fr] INFO: Saving data for DV39101: {'created_time': 1774872158.637587, 'last_price_update_time': 1774872158.637599, 'auction_closing_time': 1774970924.0}
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV39101') HTTP/1.1" 204 0
2026-03-30 12:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ74414> (referer: https://www.auto1.com/v1/car-details-view/BJ74414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36cd18bc-e028-5426-a659-d5a4d34b2df6 with identifier: BJ74414
2026-03-30 12:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cd18bc-e028-5426-a659-d5a4d34b2df6 with scrape type 1
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36cd18bc-e028-5426-a659-d5a4d34b2df6
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg not downloaded yet
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_92bf1adeab501e8d7444fc834ffe45f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_92bf1adeab501e8d7444fc834ffe45f0.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg not downloaded yet
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_77f19a3b45ef0aff3b48ba3762473388.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_77f19a3b45ef0aff3b48ba3762473388.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_f5f619f783113b86f4c892da285c61bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_f5f619f783113b86f4c892da285c61bb.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_bf77ba6c2fe6942b55c9d3f06b05b7f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_bf77ba6c2fe6942b55c9d3f06b05b7f7.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_c55e2e37d29a95e99241d6f0fde01a73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_c55e2e37d29a95e99241d6f0fde01a73.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_65707197f4117cb0b4becd94984fcc2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_65707197f4117cb0b4becd94984fcc2e.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_dc04098c3f80718c834b9e5fa20da51b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_dc04098c3f80718c834b9e5fa20da51b.jpg already downloaded
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_a0d09c98361734189a6d2ca2f407c7b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a0d09c98361734189a6d2ca2f407c7b9.jpg already downloaded
2026-03-30 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT75907> (referer: https://www.auto1.com/v1/car-details-view/AT75907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d with identifier: AT75907
2026-03-30 12:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d with scrape type 1
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_3eea10a8a0c2a61c97cb06e0cb8338c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3eea10a8a0c2a61c97cb06e0cb8338c5.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_d1aa7a87ff0086b5792677f3b473768a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_d1aa7a87ff0086b5792677f3b473768a.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_cdcc60e0a847c46b8c1c398daa0b33a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_cdcc60e0a847c46b8c1c398daa0b33a4.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_5612bb0aa92a7c352cdbe8ab8d9950bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_5612bb0aa92a7c352cdbe8ab8d9950bf.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_e600b2a2219ab18228d25fe1deadd80c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_e600b2a2219ab18228d25fe1deadd80c.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_910efc74b5b0f07134387162574aef38.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_910efc74b5b0f07134387162574aef38.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_3745d979d10e04b51a656036e1ef7e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3745d979d10e04b51a656036e1ef7e06.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_3bf9f98d00077201da6a4c76b31ce80c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3bf9f98d00077201da6a4c76b31ce80c.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_281831a0494e02a4bfa00c8376395036.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_281831a0494e02a4bfa00c8376395036.jpg already downloaded
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F7d%252F4a7d026f054a5acb635d2ab10408d582%252Fpa%252FAT75907_05bc42eabcdf27f2dc314180bd54f575.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_05bc42eabcdf27f2dc314180bd54f575.jpg already downloaded
2026-03-30 12:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d, identifier: AT75907
2026-03-30 12:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d with identifier: AT75907
2026-03-30 12:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d with identifier: AT75907
2026-03-30 12:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d with identifier: AT75907 to the API
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AT75907>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:21:10Z',
'fuel_type': 'diesel',
'id': 'cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT75907',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 272022,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3eea10a8a0c2a61c97cb06e0cb8338c5.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_d1aa7a87ff0086b5792677f3b473768a.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_cdcc60e0a847c46b8c1c398daa0b33a4.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_5612bb0aa92a7c352cdbe8ab8d9950bf.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_e600b2a2219ab18228d25fe1deadd80c.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_910efc74b5b0f07134387162574aef38.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3745d979d10e04b51a656036e1ef7e06.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3bf9f98d00077201da6a4c76b31ce80c.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_281831a0494e02a4bfa00c8376395036.jpg',
'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_05bc42eabcdf27f2dc314180bd54f575.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3eea10a8a0c2a61c97cb06e0cb8338c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_d1aa7a87ff0086b5792677f3b473768a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_cdcc60e0a847c46b8c1c398daa0b33a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_5612bb0aa92a7c352cdbe8ab8d9950bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_e600b2a2219ab18228d25fe1deadd80c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_910efc74b5b0f07134387162574aef38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3745d979d10e04b51a656036e1ef7e06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_3bf9f98d00077201da6a4c76b31ce80c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_281831a0494e02a4bfa00c8376395036.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d/cd0dffcd-11c7-53e7-93dc-bacc03d9ae0d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/7d/4a7d026f054a5acb635d2ab10408d582/pa/AT75907_05bc42eabcdf27f2dc314180bd54f575.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Picasso 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2012}
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT75907%27 HTTP/1.1" 200 None
2026-03-30 12:02:40 [auto1.fr] INFO: Saving data for AT75907: {'created_time': 1774872160.802674, 'last_price_update_time': 1774872160.802686, 'auction_closing_time': 1774970470.0}
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AT75907') HTTP/1.1" 204 0
2026-03-30 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab03990>
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg saved to cache
2026-03-30 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36cd18bc-e028-5426-a659-d5a4d34b2df6
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7f390>
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F75%252F1675f60bb62d7de6e8515d5ac62d7bd9%252Fpa%252FBJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg saved to cache
2026-03-30 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36cd18bc-e028-5426-a659-d5a4d34b2df6
2026-03-30 12:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36cd18bc-e028-5426-a659-d5a4d34b2df6, skipping ID generation
2026-03-30 12:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cd18bc-e028-5426-a659-d5a4d34b2df6 with scrape type 1
2026-03-30 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36cd18bc-e028-5426-a659-d5a4d34b2df6 sending to next pipeline
2026-03-30 12:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36cd18bc-e028-5426-a659-d5a4d34b2df6, identifier: BJ74414
2026-03-30 12:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36cd18bc-e028-5426-a659-d5a4d34b2df6 with identifier: BJ74414
2026-03-30 12:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36cd18bc-e028-5426-a659-d5a4d34b2df6 with identifier: BJ74414
2026-03-30 12:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36cd18bc-e028-5426-a659-d5a4d34b2df6 with identifier: BJ74414 to the API
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:41:37Z',
'fuel_type': 'diesel',
'id': '36cd18bc-e028-5426-a659-d5a4d34b2df6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ74414',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Renault',
'model': 'Koleos',
'odometer': 105245,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a3910daf05ce5043ce59fda7b2ffa30b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_92bf1adeab501e8d7444fc834ffe45f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_4d994b3c52131c4fc1489402ab22ab00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_77f19a3b45ef0aff3b48ba3762473388.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_f5f619f783113b86f4c892da285c61bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_bf77ba6c2fe6942b55c9d3f06b05b7f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_c55e2e37d29a95e99241d6f0fde01a73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_65707197f4117cb0b4becd94984fcc2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_dc04098c3f80718c834b9e5fa20da51b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cd18bc-e028-5426-a659-d5a4d34b2df6/36cd18bc-e028-5426-a659-d5a4d34b2df6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/75/1675f60bb62d7de6e8515d5ac62d7bd9/pa/BJ74414_a0d09c98361734189a6d2ca2f407c7b9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Koleos 1.6 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2018}
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ74414%27 HTTP/1.1" 200 None
2026-03-30 12:02:41 [auto1.fr] INFO: Saving data for BJ74414: {'created_time': 1774872161.85665, 'last_price_update_time': 1774872161.85666, 'auction_closing_time': 1774971697.0}
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ74414') HTTP/1.1" 204 0
2026-03-30 12:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB55428> (referer: https://www.auto1.com/v1/car-details-view/XB55428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413d8f7d-41d5-5848-a2f9-f1e4788f85d9 with identifier: XB55428
2026-03-30 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413d8f7d-41d5-5848-a2f9-f1e4788f85d9 with scrape type 1
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 413d8f7d-41d5-5848-a2f9-f1e4788f85d9
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_3da4c10c23bd40027dc64ea1029227f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_3da4c10c23bd40027dc64ea1029227f4.jpg already downloaded
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_b8eb8b68c6864314e3698ca7122cbda8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_b8eb8b68c6864314e3698ca7122cbda8.jpg already downloaded
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_e8d784d5a6ac9e84f3c1cc6f95c99734.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e8d784d5a6ac9e84f3c1cc6f95c99734.jpg already downloaded
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_e60eb3d8fef10d4f983c366071ca9f36.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e60eb3d8fef10d4f983c366071ca9f36.jpg already downloaded
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_fb98066a93f6b0fb1de26f19bba35334.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_fb98066a93f6b0fb1de26f19bba35334.jpg already downloaded
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F8d%252F448d530e2f470e6506d63b187129f589%252Fpa%252FXB55428_f60dca4157b1cb88d5cb19c009c613e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_f60dca4157b1cb88d5cb19c009c613e9.jpg already downloaded
2026-03-30 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 413d8f7d-41d5-5848-a2f9-f1e4788f85d9, identifier: XB55428
2026-03-30 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 413d8f7d-41d5-5848-a2f9-f1e4788f85d9 with identifier: XB55428
2026-03-30 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 413d8f7d-41d5-5848-a2f9-f1e4788f85d9 with identifier: XB55428
2026-03-30 12:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 413d8f7d-41d5-5848-a2f9-f1e4788f85d9 with identifier: XB55428 to the API
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB55428>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:29:30Z',
'fuel_type': 'diesel',
'id': '413d8f7d-41d5-5848-a2f9-f1e4788f85d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB55428',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '207',
'odometer': 300215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_3da4c10c23bd40027dc64ea1029227f4.jpg',
'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_b8eb8b68c6864314e3698ca7122cbda8.jpg',
'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e8d784d5a6ac9e84f3c1cc6f95c99734.jpg',
'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e60eb3d8fef10d4f983c366071ca9f36.jpg',
'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_fb98066a93f6b0fb1de26f19bba35334.jpg',
'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_f60dca4157b1cb88d5cb19c009c613e9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_3da4c10c23bd40027dc64ea1029227f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_b8eb8b68c6864314e3698ca7122cbda8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e8d784d5a6ac9e84f3c1cc6f95c99734.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_e60eb3d8fef10d4f983c366071ca9f36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_fb98066a93f6b0fb1de26f19bba35334.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413d8f7d-41d5-5848-a2f9-f1e4788f85d9/413d8f7d-41d5-5848-a2f9-f1e4788f85d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/8d/448d530e2f470e6506d63b187129f589/pa/XB55428_f60dca4157b1cb88d5cb19c009c613e9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2009}
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB55428%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.fr] INFO: Saving data for XB55428: {'created_time': 1774872166.758805, 'last_price_update_time': 1774872166.75882, 'auction_closing_time': 1774970970.0}
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB55428') HTTP/1.1" 204 0
2026-03-30 12:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX26854> (referer: https://www.auto1.com/v1/car-details-view/VX26854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb194234-1c35-527b-8667-c6352076f22a with identifier: VX26854
2026-03-30 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb194234-1c35-527b-8667-c6352076f22a with scrape type 1
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb194234-1c35-527b-8667-c6352076f22a
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_d2cb8b590dc5ea5e52e10feb3f745930.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d2cb8b590dc5ea5e52e10feb3f745930.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_d1044da87c51baaf93eca63acdc10f6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d1044da87c51baaf93eca63acdc10f6c.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_670827fbc686e931a25b34d34340658a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_670827fbc686e931a25b34d34340658a.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_e246f56295e320e4ee87780e3f6e0d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_e246f56295e320e4ee87780e3f6e0d26.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_eb21eec36b0d07f7a752f3abaada0666.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_eb21eec36b0d07f7a752f3abaada0666.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_65ac239f66071512f1662b8bba7222bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_65ac239f66071512f1662b8bba7222bd.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_ff2e05328d1c20c7ab75ef68e8f79880.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_ff2e05328d1c20c7ab75ef68e8f79880.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_009bed70094acb04afef53e80540a78e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_009bed70094acb04afef53e80540a78e.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_4543dc9f2c8a1122cd9b43eb64db1377.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_4543dc9f2c8a1122cd9b43eb64db1377.jpg already downloaded
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F67%252Ff567715090e9edcd616ae1cc48de7b59%252Fpa%252FVX26854_911290e1f4b7ce4a4488696350c82fd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_911290e1f4b7ce4a4488696350c82fd1.jpg already downloaded
2026-03-30 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb194234-1c35-527b-8667-c6352076f22a, identifier: VX26854
2026-03-30 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb194234-1c35-527b-8667-c6352076f22a with identifier: VX26854
2026-03-30 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb194234-1c35-527b-8667-c6352076f22a with identifier: VX26854
2026-03-30 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb194234-1c35-527b-8667-c6352076f22a with identifier: VX26854 to the API
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX26854>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:10:04Z',
'fuel_type': 'petrol',
'id': 'eb194234-1c35-527b-8667-c6352076f22a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX26854',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 171988,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d2cb8b590dc5ea5e52e10feb3f745930.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d1044da87c51baaf93eca63acdc10f6c.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_670827fbc686e931a25b34d34340658a.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_e246f56295e320e4ee87780e3f6e0d26.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_eb21eec36b0d07f7a752f3abaada0666.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_65ac239f66071512f1662b8bba7222bd.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_ff2e05328d1c20c7ab75ef68e8f79880.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_009bed70094acb04afef53e80540a78e.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_4543dc9f2c8a1122cd9b43eb64db1377.jpg',
'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_911290e1f4b7ce4a4488696350c82fd1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d2cb8b590dc5ea5e52e10feb3f745930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_d1044da87c51baaf93eca63acdc10f6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_670827fbc686e931a25b34d34340658a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_e246f56295e320e4ee87780e3f6e0d26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2386104,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_eb21eec36b0d07f7a752f3abaada0666.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_65ac239f66071512f1662b8bba7222bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049498,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_ff2e05328d1c20c7ab75ef68e8f79880.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2175219,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_009bed70094acb04afef53e80540a78e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_4543dc9f2c8a1122cd9b43eb64db1377.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb194234-1c35-527b-8667-c6352076f22a/eb194234-1c35-527b-8667-c6352076f22a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/67/f567715090e9edcd616ae1cc48de7b59/pa/VX26854_911290e1f4b7ce4a4488696350c82fd1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2018}
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX26854%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.fr] INFO: Saving data for VX26854: {'created_time': 1774872168.422206, 'last_price_update_time': 1774872168.422216, 'auction_closing_time': 1774969804.0}
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX26854') HTTP/1.1" 204 0
2026-03-30 12:02:48 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 18 pages/min), scraped 25 items (at 11 items/min)
2026-03-30 12:02:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 12:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH83652> (referer: https://www.auto1.com/v1/car-details-view/KH83652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ce959f-0fe9-5c12-928c-0250a1e27b89 with identifier: KH83652
2026-03-30 12:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ce959f-0fe9-5c12-928c-0250a1e27b89 with scrape type 1
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a5ce959f-0fe9-5c12-928c-0250a1e27b89
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_67b72edabfde973071556171c0e1df96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_67b72edabfde973071556171c0e1df96.jpg already downloaded
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_b32aab44a2e9883648475583006ca6f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_b32aab44a2e9883648475583006ca6f7.jpg already downloaded
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_827e60d42101972295a1dc7edfc7539d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_827e60d42101972295a1dc7edfc7539d.jpg already downloaded
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_eea5dbeb422263d4bcc3824210fe296c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_eea5dbeb422263d4bcc3824210fe296c.jpg already downloaded
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_8ce22c359e147183b6e147420e62eaab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_8ce22c359e147183b6e147420e62eaab.jpg already downloaded
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F7e%252Fd57e02492472c0711c4fb173d5b96c4e%252Fpa%252FKH83652_e3c352efbc47642676007852f08f6bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_e3c352efbc47642676007852f08f6bff.jpg already downloaded
2026-03-30 12:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5ce959f-0fe9-5c12-928c-0250a1e27b89, identifier: KH83652
2026-03-30 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5ce959f-0fe9-5c12-928c-0250a1e27b89 with identifier: KH83652
2026-03-30 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5ce959f-0fe9-5c12-928c-0250a1e27b89 with identifier: KH83652
2026-03-30 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5ce959f-0fe9-5c12-928c-0250a1e27b89 with identifier: KH83652 to the API
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH83652>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:35:43Z',
'fuel_type': 'diesel',
'id': 'a5ce959f-0fe9-5c12-928c-0250a1e27b89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH83652',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '207',
'odometer': 201868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_67b72edabfde973071556171c0e1df96.jpg',
'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_b32aab44a2e9883648475583006ca6f7.jpg',
'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_827e60d42101972295a1dc7edfc7539d.jpg',
'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_eea5dbeb422263d4bcc3824210fe296c.jpg',
'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_8ce22c359e147183b6e147420e62eaab.jpg',
'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_e3c352efbc47642676007852f08f6bff.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_67b72edabfde973071556171c0e1df96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_b32aab44a2e9883648475583006ca6f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_827e60d42101972295a1dc7edfc7539d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_eea5dbeb422263d4bcc3824210fe296c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_8ce22c359e147183b6e147420e62eaab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ce959f-0fe9-5c12-928c-0250a1e27b89/a5ce959f-0fe9-5c12-928c-0250a1e27b89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/7e/d57e02492472c0711c4fb173d5b96c4e/pa/KH83652_e3c352efbc47642676007852f08f6bff.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Affaire Pack CD Clim',
'transmission': 'manual',
'trim': 'Affaire Pack CD Clim',
'year': 2008}
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH83652%27 HTTP/1.1" 200 None
2026-03-30 12:02:51 [auto1.fr] INFO: Saving data for KH83652: {'created_time': 1774872171.981527, 'last_price_update_time': 1774872171.981537, 'auction_closing_time': 1774971343.0}
2026-03-30 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH83652') HTTP/1.1" 204 0
2026-03-30 12:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:54 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 5691 | hits on page: 40
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: NY25826
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: BJ69793
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: RK77632
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: MG57565
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: CM40964
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: VN88845
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: ZB65239
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: KV40050
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: HK32331
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: AM96995
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: HT52883
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: FH12619
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: DX08652
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX08652%27 HTTP/1.1" 200 None
2026-03-30 12:02:54 [auto1.fr] INFO: Scrape type for DX08652: 2
2026-03-30 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49cce6e4-bcef-5a4d-a093-12dcbe594210 with identifier: DX08652
2026-03-30 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49cce6e4-bcef-5a4d-a093-12dcbe594210 with scrape type 2
2026-03-30 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49cce6e4-bcef-5a4d-a093-12dcbe594210 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 49cce6e4-bcef-5a4d-a093-12dcbe594210, identifier: DX08652
2026-03-30 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49cce6e4-bcef-5a4d-a093-12dcbe594210 with identifier: DX08652
2026-03-30 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49cce6e4-bcef-5a4d-a093-12dcbe594210 with identifier: DX08652
2026-03-30 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49cce6e4-bcef-5a4d-a093-12dcbe594210 with identifier: DX08652 to the API
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:18:24Z',
'fuel_type': 'diesel',
'id': '49cce6e4-bcef-5a4d-a093-12dcbe594210',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX08652',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 217120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-03',
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Cosmo Pack ecoFlex',
'transmission': 'manual',
'trim': 'Cosmo Pack ecoFlex',
'year': 2015}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX08652%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Saving data for DX08652: {'auction_closing_time': 1774970304.0, 'created_time': 1774269643.706777, 'last_price_update_time': 1774872175.398172}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DX08652') HTTP/1.1" 204 0
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: YY12321
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: BZ11243
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: MC30629
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: FA81163
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA81163%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Scrape type for FA81163: 1
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: KL53133
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL53133%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Scrape type for KL53133: 2
2026-03-30 12:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefa2c6b-c3a4-57b8-bcb4-34d372245831 with identifier: KL53133
2026-03-30 12:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefa2c6b-c3a4-57b8-bcb4-34d372245831 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fefa2c6b-c3a4-57b8-bcb4-34d372245831 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fefa2c6b-c3a4-57b8-bcb4-34d372245831, identifier: KL53133
2026-03-30 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fefa2c6b-c3a4-57b8-bcb4-34d372245831 with identifier: KL53133
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fefa2c6b-c3a4-57b8-bcb4-34d372245831 with identifier: KL53133
2026-03-30 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fefa2c6b-c3a4-57b8-bcb4-34d372245831 with identifier: KL53133 to the API
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 404,
'expiration_date': '2026-03-31T15:08:11Z',
'fuel_type': 'hybrid',
'id': 'fefa2c6b-c3a4-57b8-bcb4-34d372245831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53133',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 49144,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-08',
'seller_name': None,
'title': 'Land Rover Defender P400e Plug-in Hybrid 110 S',
'transmission': 'automatic',
'trim': '110 S',
'year': 2023}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL53133%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Saving data for KL53133: {'auction_closing_time': 1774969691.0, 'created_time': 1773144036.245776, 'last_price_update_time': 1774872176.161216}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL53133') HTTP/1.1" 204 0
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: LD88363
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD88363%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Scrape type for LD88363: 2
2026-03-30 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42d8036d-789b-52d5-86e3-eb1a53bfb81f with identifier: LD88363
2026-03-30 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42d8036d-789b-52d5-86e3-eb1a53bfb81f with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42d8036d-789b-52d5-86e3-eb1a53bfb81f with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42d8036d-789b-52d5-86e3-eb1a53bfb81f, identifier: LD88363
2026-03-30 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42d8036d-789b-52d5-86e3-eb1a53bfb81f with identifier: LD88363
2026-03-30 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42d8036d-789b-52d5-86e3-eb1a53bfb81f with identifier: LD88363
2026-03-30 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 42d8036d-789b-52d5-86e3-eb1a53bfb81f with identifier: LD88363 to the API
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:39:25Z',
'fuel_type': 'petrol',
'id': '42d8036d-789b-52d5-86e3-eb1a53bfb81f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD88363',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 110895,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD88363%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Saving data for LD88363: {'auction_closing_time': 1774971565.0, 'created_time': 1773676203.843884, 'last_price_update_time': 1774872176.627901}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LD88363') HTTP/1.1" 204 0
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: AE60263
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: HJ00300
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: PU50032
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA05158%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Scrape type for RA05158: 2
2026-03-30 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with identifier: RA05158
2026-03-30 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6760eb5a-a18b-5f47-8bd1-03e5e4b71341, identifier: RA05158
2026-03-30 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with identifier: RA05158
2026-03-30 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with identifier: RA05158
2026-03-30 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6760eb5a-a18b-5f47-8bd1-03e5e4b71341 with identifier: RA05158 to the API
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:40:46Z',
'fuel_type': 'petrol',
'id': '6760eb5a-a18b-5f47-8bd1-03e5e4b71341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA05158',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 121847,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-11',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA05158%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Saving data for RA05158: {'auction_closing_time': 1774971646.0, 'created_time': 1774354060.689323, 'last_price_update_time': 1774872177.072894}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA05158') HTTP/1.1" 204 0
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ81216%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Scrape type for VZ81216: 1
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC68759%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Scrape type for TC68759: 2
2026-03-30 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4429807d-db24-519e-a9b2-e60fd4669f34 with identifier: TC68759
2026-03-30 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4429807d-db24-519e-a9b2-e60fd4669f34 with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4429807d-db24-519e-a9b2-e60fd4669f34 with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4429807d-db24-519e-a9b2-e60fd4669f34, identifier: TC68759
2026-03-30 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4429807d-db24-519e-a9b2-e60fd4669f34 with identifier: TC68759
2026-03-30 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4429807d-db24-519e-a9b2-e60fd4669f34 with identifier: TC68759
2026-03-30 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4429807d-db24-519e-a9b2-e60fd4669f34 with identifier: TC68759 to the API
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:51:32Z',
'fuel_type': 'diesel',
'id': '4429807d-db24-519e-a9b2-e60fd4669f34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC68759',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 158755,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-17',
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D3 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2015}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC68759%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Saving data for TC68759: {'auction_closing_time': 1774972292.0, 'created_time': 1773219222.244059, 'last_price_update_time': 1774872177.607524}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC68759') HTTP/1.1" 204 0
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW53628%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Scrape type for CW53628: 1
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC44868%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Scrape type for DC44868: 2
2026-03-30 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a6e926-f6ef-5765-81c6-69ee7d07e83a with identifier: DC44868
2026-03-30 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a6e926-f6ef-5765-81c6-69ee7d07e83a with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a6e926-f6ef-5765-81c6-69ee7d07e83a with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15a6e926-f6ef-5765-81c6-69ee7d07e83a, identifier: DC44868
2026-03-30 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15a6e926-f6ef-5765-81c6-69ee7d07e83a with identifier: DC44868
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15a6e926-f6ef-5765-81c6-69ee7d07e83a with identifier: DC44868
2026-03-30 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15a6e926-f6ef-5765-81c6-69ee7d07e83a with identifier: DC44868 to the API
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:31:39Z',
'fuel_type': 'petrol',
'id': '15a6e926-f6ef-5765-81c6-69ee7d07e83a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC44868',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 100029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC44868%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [auto1.fr] INFO: Saving data for DC44868: {'auction_closing_time': 1774971099.0, 'created_time': 1773053954.153725, 'last_price_update_time': 1774872178.415762}
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC44868') HTTP/1.1" 204 0
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US33536%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [auto1.fr] INFO: Scrape type for US33536: 1
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN56333%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [auto1.fr] INFO: Scrape type for VN56333: 1
2026-03-30 12:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA52585> (referer: https://www.auto1.com/v1/car-details-view/UA52585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:58 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 12:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70053d95-be81-5f79-ae69-3c12bab5732f with identifier: UA52585
2026-03-30 12:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70053d95-be81-5f79-ae69-3c12bab5732f with scrape type 1
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 70053d95-be81-5f79-ae69-3c12bab5732f
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_f04975e76568ba2e54bb5e523590736b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_f04975e76568ba2e54bb5e523590736b.jpg already downloaded
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_89962f591680f1a44ac42cf0590dc805.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_89962f591680f1a44ac42cf0590dc805.jpg already downloaded
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_96cb28fe8a3d34efd92e3694409b5093.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_96cb28fe8a3d34efd92e3694409b5093.jpg already downloaded
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_905e3a4917e9803f05c2d0fc33ab86a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_905e3a4917e9803f05c2d0fc33ab86a9.jpg already downloaded
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_6df7c5ea349166387c41fa5e7f8315ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_6df7c5ea349166387c41fa5e7f8315ce.jpg already downloaded
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8c%252F3a8c2e6de46c329ebca88556627e0ad4%252Fpa%252FUA52585_d5f751859fdfc3115d4b86fc0c90ec95.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_d5f751859fdfc3115d4b86fc0c90ec95.jpg already downloaded
2026-03-30 12:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70053d95-be81-5f79-ae69-3c12bab5732f, identifier: UA52585
2026-03-30 12:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70053d95-be81-5f79-ae69-3c12bab5732f with identifier: UA52585
2026-03-30 12:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70053d95-be81-5f79-ae69-3c12bab5732f with identifier: UA52585
2026-03-30 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70053d95-be81-5f79-ae69-3c12bab5732f with identifier: UA52585 to the API
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA52585>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:26:44Z',
'fuel_type': 'diesel',
'id': '70053d95-be81-5f79-ae69-3c12bab5732f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA52585',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Peugeot',
'model': '207',
'odometer': 222990,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_f04975e76568ba2e54bb5e523590736b.jpg',
'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_89962f591680f1a44ac42cf0590dc805.jpg',
'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_96cb28fe8a3d34efd92e3694409b5093.jpg',
'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_905e3a4917e9803f05c2d0fc33ab86a9.jpg',
'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_6df7c5ea349166387c41fa5e7f8315ce.jpg',
'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_d5f751859fdfc3115d4b86fc0c90ec95.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_f04975e76568ba2e54bb5e523590736b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_89962f591680f1a44ac42cf0590dc805.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_96cb28fe8a3d34efd92e3694409b5093.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_905e3a4917e9803f05c2d0fc33ab86a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_6df7c5ea349166387c41fa5e7f8315ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70053d95-be81-5f79-ae69-3c12bab5732f/70053d95-be81-5f79-ae69-3c12bab5732f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/8c/3a8c2e6de46c329ebca88556627e0ad4/pa/UA52585_d5f751859fdfc3115d4b86fc0c90ec95.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2011}
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52585%27 HTTP/1.1" 200 None
2026-03-30 12:02:59 [auto1.fr] INFO: Saving data for UA52585: {'created_time': 1774872179.271804, 'last_price_update_time': 1774872179.271813, 'auction_closing_time': 1774970804.0}
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA52585') HTTP/1.1" 204 0
2026-03-30 12:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS47680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH87240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT44127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD05878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.406(s), this was the 1st time calling it.
2026-03-30 12:03:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.780222151938436 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB37386> (referer: https://www.auto1.com/v1/car-details-view/CB37386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61fc866d-3085-5802-8d44-7588b36b2309 with identifier: CB37386
2026-03-30 12:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61fc866d-3085-5802-8d44-7588b36b2309 with scrape type 1
2026-03-30 12:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61fc866d-3085-5802-8d44-7588b36b2309
2026-03-30 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_75eab1f2631bfa70aac912c0071fc9d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_75eab1f2631bfa70aac912c0071fc9d9.jpg already downloaded
2026-03-30 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_36ca6d6e9b3070946115f29fa2fc575f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_36ca6d6e9b3070946115f29fa2fc575f.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_012d1aa07318c4828d4da14ff668b158.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_012d1aa07318c4828d4da14ff668b158.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_829c35a3ad101f97d0587127ed13a760.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_829c35a3ad101f97d0587127ed13a760.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_51767693c1a39b1d0faab7c2fa53f0ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_51767693c1a39b1d0faab7c2fa53f0ee.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_8468d5fa6040b7038e4080c6b526225b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_8468d5fa6040b7038e4080c6b526225b.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_e3703438636da22ece6fef0a8a7f6b51.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_e3703438636da22ece6fef0a8a7f6b51.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_d0ccf5e192ee688195e10310b881d7c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_d0ccf5e192ee688195e10310b881d7c8.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_63d41ef8c3bd4d0c94562fc0c4ee5f4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_63d41ef8c3bd4d0c94562fc0c4ee5f4c.jpg already downloaded
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fc3%252Fc5c33ecce3b809514bda9b75da1ec3a0%252Fpa%252FCB37386_c7c03ca90b6ddea7a75013d5e5aa385b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_c7c03ca90b6ddea7a75013d5e5aa385b.jpg already downloaded
2026-03-30 12:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61fc866d-3085-5802-8d44-7588b36b2309, identifier: CB37386
2026-03-30 12:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61fc866d-3085-5802-8d44-7588b36b2309 with identifier: CB37386
2026-03-30 12:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61fc866d-3085-5802-8d44-7588b36b2309 with identifier: CB37386
2026-03-30 12:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61fc866d-3085-5802-8d44-7588b36b2309 with identifier: CB37386 to the API
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB37386>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:08:33Z',
'fuel_type': 'hybrid',
'id': '61fc866d-3085-5802-8d44-7588b36b2309',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB37386',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Suzuki',
'model': 'S-Cross',
'odometer': 24162,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_75eab1f2631bfa70aac912c0071fc9d9.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_36ca6d6e9b3070946115f29fa2fc575f.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_012d1aa07318c4828d4da14ff668b158.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_829c35a3ad101f97d0587127ed13a760.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_51767693c1a39b1d0faab7c2fa53f0ee.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_8468d5fa6040b7038e4080c6b526225b.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_e3703438636da22ece6fef0a8a7f6b51.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_d0ccf5e192ee688195e10310b881d7c8.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_63d41ef8c3bd4d0c94562fc0c4ee5f4c.jpg',
'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_c7c03ca90b6ddea7a75013d5e5aa385b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_75eab1f2631bfa70aac912c0071fc9d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_36ca6d6e9b3070946115f29fa2fc575f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_012d1aa07318c4828d4da14ff668b158.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_829c35a3ad101f97d0587127ed13a760.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_51767693c1a39b1d0faab7c2fa53f0ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_8468d5fa6040b7038e4080c6b526225b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_e3703438636da22ece6fef0a8a7f6b51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_d0ccf5e192ee688195e10310b881d7c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2175938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_63d41ef8c3bd4d0c94562fc0c4ee5f4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61fc866d-3085-5802-8d44-7588b36b2309/61fc866d-3085-5802-8d44-7588b36b2309_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2529082,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/c3/c5c33ecce3b809514bda9b75da1ec3a0/pa/CB37386_c7c03ca90b6ddea7a75013d5e5aa385b.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki S-Cross 1.5 Dualjet Hybrid ALLGRIP Comfort+',
'transmission': 'automatic',
'trim': 'ALLGRIP Comfort+',
'year': 2025}
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB37386%27 HTTP/1.1" 200 None
2026-03-30 12:03:41 [auto1.fr] INFO: Saving data for CB37386: {'created_time': 1774872221.700749, 'last_price_update_time': 1774872221.700763, 'auction_closing_time': 1774969713.0}
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB37386') HTTP/1.1" 204 0
2026-03-30 12:03:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.379(s), this was the 1st time calling it.
2026-03-30 12:03:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.785027487240195 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA81163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ81216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:48 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 10 pages/min), scraped 34 items (at 9 items/min)
2026-03-30 12:03:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 12:03:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.710(s), this was the 1st time calling it.
2026-03-30 12:03:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.0116805135697735 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ68897> (referer: https://www.auto1.com/v1/car-details-view/WJ68897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8130fbf4-33b3-523b-8dfa-a65d1f162109 with identifier: WJ68897
2026-03-30 12:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8130fbf4-33b3-523b-8dfa-a65d1f162109 with scrape type 1
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg not downloaded yet
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg not downloaded yet
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg not downloaded yet
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_ef20584cb9d71c80429b79140c207e2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_ef20584cb9d71c80429b79140c207e2b.jpg not downloaded yet
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg not downloaded yet
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg not downloaded yet
2026-03-30 12:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b43fd0>
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg saved to cache
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcaba4650>
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg saved to cache
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab30710>
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg saved to cache
2026-03-30 12:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_ef20584cb9d71c80429b79140c207e2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab1bbd0>
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_ef20584cb9d71c80429b79140c207e2b.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_ef20584cb9d71c80429b79140c207e2b.jpg saved to cache
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab790d0>
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg saved to cache
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22ca10>
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc3%252F45c35dbb0383c4118d47fa73c4aa129d%252Fpa%252FWJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg saved to cache
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8130fbf4-33b3-523b-8dfa-a65d1f162109
2026-03-30 12:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8130fbf4-33b3-523b-8dfa-a65d1f162109, skipping ID generation
2026-03-30 12:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8130fbf4-33b3-523b-8dfa-a65d1f162109 with scrape type 1
2026-03-30 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8130fbf4-33b3-523b-8dfa-a65d1f162109 sending to next pipeline
2026-03-30 12:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8130fbf4-33b3-523b-8dfa-a65d1f162109, identifier: WJ68897
2026-03-30 12:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8130fbf4-33b3-523b-8dfa-a65d1f162109 with identifier: WJ68897
2026-03-30 12:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8130fbf4-33b3-523b-8dfa-a65d1f162109 with identifier: WJ68897
2026-03-30 12:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8130fbf4-33b3-523b-8dfa-a65d1f162109 with identifier: WJ68897 to the API
2026-03-30 12:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:17:48Z',
'fuel_type': 'diesel',
'id': '8130fbf4-33b3-523b-8dfa-a65d1f162109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ68897',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Renault',
'model': 'Laguna',
'odometer': 145223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_55d37fe856642fa2b00bbfa8f938717a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_85f824ec2fe403447d6e8a52bc2f8669.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_e6e1e6e7caa2e6a39fe2795f6c6123da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_ef20584cb9d71c80429b79140c207e2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f11d893ba7810c153f69c4a28be0fdde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8130fbf4-33b3-523b-8dfa-a65d1f162109/8130fbf4-33b3-523b-8dfa-a65d1f162109_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c3/45c35dbb0383c4118d47fa73c4aa129d/pa/WJ68897_f01f07547c3ccd6a08fab804a82fe53d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2007}
2026-03-30 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ68897%27 HTTP/1.1" 200 None
2026-03-30 12:03:58 [auto1.fr] INFO: Saving data for WJ68897: {'created_time': 1774872238.080867, 'last_price_update_time': 1774872238.080881, 'auction_closing_time': 1774970268.0}
2026-03-30 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ68897') HTTP/1.1" 204 0
2026-03-30 12:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW53628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US33536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV64764/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS47680> (referer: https://www.auto1.com/v1/car-details-view/SS47680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8357ffab-b812-59ed-83ea-365b08d08589 with identifier: SS47680
2026-03-30 12:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8357ffab-b812-59ed-83ea-365b08d08589 with scrape type 1
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8357ffab-b812-59ed-83ea-365b08d08589
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_3185f783cf0a669dd5a9bc0cb0f08a68.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_3185f783cf0a669dd5a9bc0cb0f08a68.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_d6f12d4a048276b8f618866589c2f7b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d6f12d4a048276b8f618866589c2f7b3.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_1daf49010c3802d13d9626611cadfc3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1daf49010c3802d13d9626611cadfc3a.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_0d709400c8728aaa3697d6c73eef8bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_0d709400c8728aaa3697d6c73eef8bc2.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_4b860736a6b5ce1969c67b2809c3bd2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_4b860736a6b5ce1969c67b2809c3bd2d.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_88ee57728e11500d00ddd93458f7bc5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_88ee57728e11500d00ddd93458f7bc5a.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_ca96156b39383d2042b3129322acea58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_ca96156b39383d2042b3129322acea58.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_1f9d61c16e4555fe8cfbcf15780032d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1f9d61c16e4555fe8cfbcf15780032d2.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_be0bd9724417a491b003a27860866afc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_be0bd9724417a491b003a27860866afc.jpg already downloaded
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb9%252F73b94487b0ae0822d2d4d3b218b9a147%252Fpa%252FSS47680_d1d57a17c72e9ac2ac30e5af15ad5fef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d1d57a17c72e9ac2ac30e5af15ad5fef.jpg already downloaded
2026-03-30 12:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8357ffab-b812-59ed-83ea-365b08d08589, identifier: SS47680
2026-03-30 12:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8357ffab-b812-59ed-83ea-365b08d08589 with identifier: SS47680
2026-03-30 12:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8357ffab-b812-59ed-83ea-365b08d08589 with identifier: SS47680
2026-03-30 12:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8357ffab-b812-59ed-83ea-365b08d08589 with identifier: SS47680 to the API
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS47680>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': 'Taxi',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:37:03Z',
'fuel_type': 'diesel',
'id': '8357ffab-b812-59ed-83ea-365b08d08589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS47680',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 88521,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_3185f783cf0a669dd5a9bc0cb0f08a68.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d6f12d4a048276b8f618866589c2f7b3.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1daf49010c3802d13d9626611cadfc3a.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_0d709400c8728aaa3697d6c73eef8bc2.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_4b860736a6b5ce1969c67b2809c3bd2d.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_88ee57728e11500d00ddd93458f7bc5a.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_ca96156b39383d2042b3129322acea58.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1f9d61c16e4555fe8cfbcf15780032d2.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_be0bd9724417a491b003a27860866afc.jpg',
'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d1d57a17c72e9ac2ac30e5af15ad5fef.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_3185f783cf0a669dd5a9bc0cb0f08a68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2950544,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d6f12d4a048276b8f618866589c2f7b3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1daf49010c3802d13d9626611cadfc3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_0d709400c8728aaa3697d6c73eef8bc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_4b860736a6b5ce1969c67b2809c3bd2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2911240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_88ee57728e11500d00ddd93458f7bc5a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027823,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_ca96156b39383d2042b3129322acea58.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2866149,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_1f9d61c16e4555fe8cfbcf15780032d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_be0bd9724417a491b003a27860866afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8357ffab-b812-59ed-83ea-365b08d08589/8357ffab-b812-59ed-83ea-365b08d08589_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/b9/73b94487b0ae0822d2d4d3b218b9a147/pa/SS47680_d1d57a17c72e9ac2ac30e5af15ad5fef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-12',
'seats_number': 9,
'seller_name': None,
'title': 'Opel Vivaro 1.5 CDTI M L2',
'transmission': 'manual',
'trim': 'M L2',
'year': 2021}
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS47680%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [auto1.fr] INFO: Saving data for SS47680: {'created_time': 1774872244.974277, 'last_price_update_time': 1774872244.974288, 'auction_closing_time': 1774971423.0}
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS47680') HTTP/1.1" 204 0
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.673(s), this was the 1st time calling it.
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.358196125509922 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH87240> (referer: https://www.auto1.com/v1/car-details-view/MH87240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753b168a-cd4e-58d9-b26f-795d29227211 with identifier: MH87240
2026-03-30 12:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753b168a-cd4e-58d9-b26f-795d29227211 with scrape type 1
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 753b168a-cd4e-58d9-b26f-795d29227211
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_d5fcf2b2fa33ee5c6b24cf38bda3b2ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_d5fcf2b2fa33ee5c6b24cf38bda3b2ea.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_7b322e84a8bdcbc5f939b78e160325ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_7b322e84a8bdcbc5f939b78e160325ca.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_3854639aadc752d691c97f2d8fdf485f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_3854639aadc752d691c97f2d8fdf485f.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_b46342b255dc8e68365df7cc648f2ace.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_b46342b255dc8e68365df7cc648f2ace.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_92e0632f2f0e27e6649926ac87668cb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_92e0632f2f0e27e6649926ac87668cb2.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_50f6488c0c68e07983f41704f231fd9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_50f6488c0c68e07983f41704f231fd9c.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_2607dc7e55350a5abfd39e56f6bc7857.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_2607dc7e55350a5abfd39e56f6bc7857.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_83bb5a1099a617670ebc0488f948c253.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_83bb5a1099a617670ebc0488f948c253.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_fe94306f7cc6d4f481cf4286b2c8524f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_fe94306f7cc6d4f481cf4286b2c8524f.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F96%252Fa696dfac899418fda6a5146ffb12e2e4%252Fpa%252FMH87240_5360a8e402478e6d483d73409e6a9c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_5360a8e402478e6d483d73409e6a9c3b.jpg already downloaded
2026-03-30 12:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 753b168a-cd4e-58d9-b26f-795d29227211, identifier: MH87240
2026-03-30 12:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 753b168a-cd4e-58d9-b26f-795d29227211 with identifier: MH87240
2026-03-30 12:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 753b168a-cd4e-58d9-b26f-795d29227211 with identifier: MH87240
2026-03-30 12:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 753b168a-cd4e-58d9-b26f-795d29227211 with identifier: MH87240 to the API
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH87240>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:27Z',
'fuel_type': 'petrol',
'id': '753b168a-cd4e-58d9-b26f-795d29227211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH87240',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '2008',
'odometer': 38441,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_d5fcf2b2fa33ee5c6b24cf38bda3b2ea.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_7b322e84a8bdcbc5f939b78e160325ca.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_3854639aadc752d691c97f2d8fdf485f.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_b46342b255dc8e68365df7cc648f2ace.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_92e0632f2f0e27e6649926ac87668cb2.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_50f6488c0c68e07983f41704f231fd9c.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_2607dc7e55350a5abfd39e56f6bc7857.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_83bb5a1099a617670ebc0488f948c253.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_fe94306f7cc6d4f481cf4286b2c8524f.jpg',
'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_5360a8e402478e6d483d73409e6a9c3b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_d5fcf2b2fa33ee5c6b24cf38bda3b2ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_7b322e84a8bdcbc5f939b78e160325ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265479,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_3854639aadc752d691c97f2d8fdf485f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_b46342b255dc8e68365df7cc648f2ace.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_92e0632f2f0e27e6649926ac87668cb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_50f6488c0c68e07983f41704f231fd9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_2607dc7e55350a5abfd39e56f6bc7857.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_83bb5a1099a617670ebc0488f948c253.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_fe94306f7cc6d4f481cf4286b2c8524f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753b168a-cd4e-58d9-b26f-795d29227211/753b168a-cd4e-58d9-b26f-795d29227211_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/96/a696dfac899418fda6a5146ffb12e2e4/pa/MH87240_5360a8e402478e6d483d73409e6a9c3b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH87240%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [auto1.fr] INFO: Saving data for MH87240: {'created_time': 1774872246.709817, 'last_price_update_time': 1774872246.709827, 'auction_closing_time': 1774970727.0}
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MH87240') HTTP/1.1" 204 0
2026-03-30 12:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT44127> (referer: https://www.auto1.com/v1/car-details-view/NT44127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4878415-0307-51b2-bf09-56f528584652 with identifier: NT44127
2026-03-30 12:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4878415-0307-51b2-bf09-56f528584652 with scrape type 1
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4878415-0307-51b2-bf09-56f528584652
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_77a9c4df653744984be799631aa139d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_77a9c4df653744984be799631aa139d9.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_4dac8ca394ef448f94b95de686ff0305.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_4dac8ca394ef448f94b95de686ff0305.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_edc3bdda37624ebec7aaeb0f3437748f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_edc3bdda37624ebec7aaeb0f3437748f.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_181f20bafc6406ba55fccd810c7919ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_181f20bafc6406ba55fccd810c7919ff.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_61b97e5ec6e841f0ddb50b261080cd13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_61b97e5ec6e841f0ddb50b261080cd13.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_94352ae95ff23c9ea7a4d9afd5286fcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_94352ae95ff23c9ea7a4d9afd5286fcf.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_0813e7a929405469708a30ebe1ad5c1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_0813e7a929405469708a30ebe1ad5c1b.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_930545c54a660ecd7e414d6f4ccd7fd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_930545c54a660ecd7e414d6f4ccd7fd1.jpg already downloaded
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_65b2b8b7467bedfa08616da71538fc81.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_65b2b8b7467bedfa08616da71538fc81.jpg already downloaded
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd0%252F04d0ac57dd54dac0a84625eb3d385cc8%252Fpa%252FNT44127_15a6c16dd6e0a1e6bf655de5f396c9f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_15a6c16dd6e0a1e6bf655de5f396c9f3.jpg already downloaded
2026-03-30 12:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e4878415-0307-51b2-bf09-56f528584652, identifier: NT44127
2026-03-30 12:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e4878415-0307-51b2-bf09-56f528584652 with identifier: NT44127
2026-03-30 12:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e4878415-0307-51b2-bf09-56f528584652 with identifier: NT44127
2026-03-30 12:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e4878415-0307-51b2-bf09-56f528584652 with identifier: NT44127 to the API
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT44127>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:31:53Z',
'fuel_type': 'diesel',
'id': 'e4878415-0307-51b2-bf09-56f528584652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT44127',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 185329,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_77a9c4df653744984be799631aa139d9.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_4dac8ca394ef448f94b95de686ff0305.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_edc3bdda37624ebec7aaeb0f3437748f.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_181f20bafc6406ba55fccd810c7919ff.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_61b97e5ec6e841f0ddb50b261080cd13.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_94352ae95ff23c9ea7a4d9afd5286fcf.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_0813e7a929405469708a30ebe1ad5c1b.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_930545c54a660ecd7e414d6f4ccd7fd1.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_65b2b8b7467bedfa08616da71538fc81.jpg',
'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_15a6c16dd6e0a1e6bf655de5f396c9f3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3055613,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_77a9c4df653744984be799631aa139d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_4dac8ca394ef448f94b95de686ff0305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994650,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_edc3bdda37624ebec7aaeb0f3437748f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2822115,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_181f20bafc6406ba55fccd810c7919ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_61b97e5ec6e841f0ddb50b261080cd13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2934850,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_94352ae95ff23c9ea7a4d9afd5286fcf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_0813e7a929405469708a30ebe1ad5c1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_930545c54a660ecd7e414d6f4ccd7fd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2925711,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_65b2b8b7467bedfa08616da71538fc81.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4878415-0307-51b2-bf09-56f528584652/e4878415-0307-51b2-bf09-56f528584652_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d0/04d0ac57dd54dac0a84625eb3d385cc8/pa/NT44127_15a6c16dd6e0a1e6bf655de5f396c9f3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2017}
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT44127%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Saving data for NT44127: {'created_time': 1774872247.473521, 'last_price_update_time': 1774872247.473531, 'auction_closing_time': 1774971113.0}
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT44127') HTTP/1.1" 204 0
2026-03-30 12:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA81163> (referer: https://www.auto1.com/v1/car-details-view/FA81163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c805aa-8c55-5475-8db7-6abb3b4e828a with identifier: FA81163
2026-03-30 12:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c805aa-8c55-5475-8db7-6abb3b4e828a with scrape type 1
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_b11967c98651351e8054047769ad1af9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg not downloaded yet
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_4058ba02ef72842c9153e292dd9a4a92.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4058ba02ef72842c9153e292dd9a4a92.jpg not downloaded yet
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_46780ac8d72a79edc6b925fefb186f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_46780ac8d72a79edc6b925fefb186f58.jpg not downloaded yet
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_bc14173207613a952e55cd9958a38781.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_bc14173207613a952e55cd9958a38781.jpg not downloaded yet
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg not downloaded yet
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg not downloaded yet
2026-03-30 12:04:08 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13474756) larger than download warn size (10485760) in request <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg>.
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_149ebb2ae8543ae0887f8de643cb3896.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_149ebb2ae8543ae0887f8de643cb3896.jpg not downloaded yet
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_185a27144d4dec69200aa9b130131755.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_185a27144d4dec69200aa9b130131755.jpg not downloaded yet
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN00368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg not downloaded yet
2026-03-30 12:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_35df14b3f92e3572844c1df677aa1a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_35df14b3f92e3572844c1df677aa1a4f.jpg not downloaded yet
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4058ba02ef72842c9153e292dd9a4a92.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_bc14173207613a952e55cd9958a38781.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg>.
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_46780ac8d72a79edc6b925fefb186f58.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_35df14b3f92e3572844c1df677aa1a4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_149ebb2ae8543ae0887f8de643cb3896.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_185a27144d4dec69200aa9b130131755.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2529d0>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_4058ba02ef72842c9153e292dd9a4a92.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4058ba02ef72842c9153e292dd9a4a92.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2674d0>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_bc14173207613a952e55cd9958a38781.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_bc14173207613a952e55cd9958a38781.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1954d0>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_46780ac8d72a79edc6b925fefb186f58.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_46780ac8d72a79edc6b925fefb186f58.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a0490>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca199950>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_35df14b3f92e3572844c1df677aa1a4f.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_35df14b3f92e3572844c1df677aa1a4f.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1aa150>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_b11967c98651351e8054047769ad1af9.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg saved to cache
2026-03-30 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca23ff90>
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg saved to cache
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ81216> (referer: https://www.auto1.com/v1/car-details-view/VZ81216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a3850>
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg saved to cache
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f8a90>
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_149ebb2ae8543ae0887f8de643cb3896.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_149ebb2ae8543ae0887f8de643cb3896.jpg saved to cache
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f1910>
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fa8%252F2fa8d33b08dfd6fb33fc8aefa4b9157d%252Fpa%252FFA81163_185a27144d4dec69200aa9b130131755.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_185a27144d4dec69200aa9b130131755.jpg saved to cache
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c805aa-8c55-5475-8db7-6abb3b4e828a
2026-03-30 12:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c805aa-8c55-5475-8db7-6abb3b4e828a, skipping ID generation
2026-03-30 12:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c805aa-8c55-5475-8db7-6abb3b4e828a with scrape type 1
2026-03-30 12:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c805aa-8c55-5475-8db7-6abb3b4e828a sending to next pipeline
2026-03-30 12:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3c805aa-8c55-5475-8db7-6abb3b4e828a, identifier: FA81163
2026-03-30 12:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3c805aa-8c55-5475-8db7-6abb3b4e828a with identifier: FA81163
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 12:04:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3c805aa-8c55-5475-8db7-6abb3b4e828a with identifier: FA81163
2026-03-30 12:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3c805aa-8c55-5475-8db7-6abb3b4e828a with identifier: FA81163 to the API
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_185a27144d4dec69200aa9b130131755.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:59:04Z',
'fuel_type': 'diesel',
'id': 'b3c805aa-8c55-5475-8db7-6abb3b4e828a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA81163',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Laguna',
'odometer': 265936,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 13474756,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_b11967c98651351e8054047769ad1af9.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4058ba02ef72842c9153e292dd9a4a92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_46780ac8d72a79edc6b925fefb186f58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_bc14173207613a952e55cd9958a38781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_c7a69d1f5adea153a6d7c6bd8e35bcf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_afbfca41f9578217d8a53d82f8cc17c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_149ebb2ae8543ae0887f8de643cb3896.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_185a27144d4dec69200aa9b130131755.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_4b3357bd2f0e191324b98b2b5479e4ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c805aa-8c55-5475-8db7-6abb3b4e828a/b3c805aa-8c55-5475-8db7-6abb3b4e828a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/a8/2fa8d33b08dfd6fb33fc8aefa4b9157d/pa/FA81163_35df14b3f92e3572844c1df677aa1a4f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2011}
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA81163%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [auto1.fr] INFO: Saving data for FA81163: {'created_time': 1774872251.105263, 'last_price_update_time': 1774872251.105276, 'auction_closing_time': 1774972744.0}
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA81163') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d87065-0913-519a-8974-6b537ecf57b8 with identifier: VZ81216
2026-03-30 12:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d87065-0913-519a-8974-6b537ecf57b8 with scrape type 1
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_041a2bb33d98eb60b429851763d8028d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_041a2bb33d98eb60b429851763d8028d.jpg not downloaded yet
2026-03-30 12:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_2ce907153954463167138d1e39cae823.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_2ce907153954463167138d1e39cae823.jpg not downloaded yet
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6be94167ddfa964e36880c8abeda207f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6be94167ddfa964e36880c8abeda207f.jpg not downloaded yet
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_a4179b543c96f35d406acc26a53e2b04.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_a4179b543c96f35d406acc26a53e2b04.jpg not downloaded yet
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg not downloaded yet
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_041a2bb33d98eb60b429851763d8028d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg not downloaded yet
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg not downloaded yet
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg not downloaded yet
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6be94167ddfa964e36880c8abeda207f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg not downloaded yet
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_2ce907153954463167138d1e39cae823.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg not downloaded yet
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_a4179b543c96f35d406acc26a53e2b04.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f7950>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_041a2bb33d98eb60b429851763d8028d.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_041a2bb33d98eb60b429851763d8028d.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ee550>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6be94167ddfa964e36880c8abeda207f.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6be94167ddfa964e36880c8abeda207f.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca10a4d0>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_2ce907153954463167138d1e39cae823.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_2ce907153954463167138d1e39cae823.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13eb90>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b2390>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_a4179b543c96f35d406acc26a53e2b04.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_a4179b543c96f35d406acc26a53e2b04.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2abb10>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13c250>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc9225cd0>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b27d0>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a6750>
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F5b%252Faa5bdd372372ae0bd1917fbe7536d6d9%252Fpa%252FVZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg saved to cache
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7d87065-0913-519a-8974-6b537ecf57b8
2026-03-30 12:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7d87065-0913-519a-8974-6b537ecf57b8, skipping ID generation
2026-03-30 12:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d87065-0913-519a-8974-6b537ecf57b8 with scrape type 1
2026-03-30 12:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7d87065-0913-519a-8974-6b537ecf57b8 sending to next pipeline
2026-03-30 12:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7d87065-0913-519a-8974-6b537ecf57b8, identifier: VZ81216
2026-03-30 12:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7d87065-0913-519a-8974-6b537ecf57b8 with identifier: VZ81216
2026-03-30 12:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7d87065-0913-519a-8974-6b537ecf57b8 with identifier: VZ81216
2026-03-30 12:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e7d87065-0913-519a-8974-6b537ecf57b8 with identifier: VZ81216 to the API
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:13:33Z',
'fuel_type': 'diesel',
'id': 'e7d87065-0913-519a-8974-6b537ecf57b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ81216',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Scenic',
'odometer': 237377,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_041a2bb33d98eb60b429851763d8028d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_2ce907153954463167138d1e39cae823.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6be94167ddfa964e36880c8abeda207f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_a4179b543c96f35d406acc26a53e2b04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6f0152af67ca781abcea58399ee6bd9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_be5f225c6c7897dfc51cb7beefe184cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_d0a2694f85ec8d8e180ec77a81c0c7ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_6ba8d5c4d9a60a39b9ce07576335dbdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_b1db3016adacba9b77ae8907c4df8f0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7d87065-0913-519a-8974-6b537ecf57b8/e7d87065-0913-519a-8974-6b537ecf57b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/5b/aa5bdd372372ae0bd1917fbe7536d6d9/pa/VZ81216_4f0221a1740246a9f4e7bf61ba54e3b8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2010}
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ81216%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [auto1.fr] INFO: Saving data for VZ81216: {'created_time': 1774872252.375626, 'last_price_update_time': 1774872252.375637, 'auction_closing_time': 1774970013.0}
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VZ81216') HTTP/1.1" 204 0
2026-03-30 12:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD54600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW53628> (referer: https://www.auto1.com/v1/car-details-view/CW53628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb with identifier: CW53628
2026-03-30 12:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb with scrape type 1
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_8d25758dddf11b839c3cfa7882ddb0fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_8d25758dddf11b839c3cfa7882ddb0fc.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_e4d12c3c4e542126ca5c39a9f498b411.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_e4d12c3c4e542126ca5c39a9f498b411.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_ff8dc338210e3ff575e05ca29e0114a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_ff8dc338210e3ff575e05ca29e0114a6.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_685c57008ea0f98166bc84a2db0d97b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_685c57008ea0f98166bc84a2db0d97b7.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_240fbea1d23974fd6fcbf88a21b07459.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_240fbea1d23974fd6fcbf88a21b07459.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_545dc619ec8393b8db64649a10325564.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_545dc619ec8393b8db64649a10325564.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_6efc69f0f79bebcaf0e67a2ec36b34a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_6efc69f0f79bebcaf0e67a2ec36b34a6.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_1ba4ad27aff8a02dbf61fc71d2dcb1db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_1ba4ad27aff8a02dbf61fc71d2dcb1db.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_46f9eed186234390852204984c533503.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_46f9eed186234390852204984c533503.jpg already downloaded
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F47%252F9c471d1c799693b1f1c1fc816fd7bade%252Fpa%252FCW53628_3a453b9db2e78afb50579371ecbc15ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_3a453b9db2e78afb50579371ecbc15ea.jpg already downloaded
2026-03-30 12:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb, identifier: CW53628
2026-03-30 12:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb with identifier: CW53628
2026-03-30 12:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb with identifier: CW53628
2026-03-30 12:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10b29327-a55b-5bec-bfa9-5b26d9c3ccbb with identifier: CW53628 to the API
2026-03-30 12:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW53628>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:10:00Z',
'fuel_type': 'petrol',
'id': '10b29327-a55b-5bec-bfa9-5b26d9c3ccbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW53628',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Citroen',
'model': 'C3',
'odometer': 29142,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_8d25758dddf11b839c3cfa7882ddb0fc.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_e4d12c3c4e542126ca5c39a9f498b411.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_ff8dc338210e3ff575e05ca29e0114a6.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_685c57008ea0f98166bc84a2db0d97b7.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_240fbea1d23974fd6fcbf88a21b07459.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_545dc619ec8393b8db64649a10325564.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_6efc69f0f79bebcaf0e67a2ec36b34a6.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_1ba4ad27aff8a02dbf61fc71d2dcb1db.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_46f9eed186234390852204984c533503.jpg',
'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_3a453b9db2e78afb50579371ecbc15ea.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_8d25758dddf11b839c3cfa7882ddb0fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_e4d12c3c4e542126ca5c39a9f498b411.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_ff8dc338210e3ff575e05ca29e0114a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_685c57008ea0f98166bc84a2db0d97b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_240fbea1d23974fd6fcbf88a21b07459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_545dc619ec8393b8db64649a10325564.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_6efc69f0f79bebcaf0e67a2ec36b34a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_1ba4ad27aff8a02dbf61fc71d2dcb1db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_46f9eed186234390852204984c533503.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b29327-a55b-5bec-bfa9-5b26d9c3ccbb/10b29327-a55b-5bec-bfa9-5b26d9c3ccbb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/47/9c471d1c799693b1f1c1fc816fd7bade/pa/CW53628_3a453b9db2e78afb50579371ecbc15ea.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-05',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2020}
2026-03-30 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW53628%27 HTTP/1.1" 200 None
2026-03-30 12:04:13 [auto1.fr] INFO: Saving data for CW53628: {'created_time': 1774872253.220454, 'last_price_update_time': 1774872253.220464, 'auction_closing_time': 1774969800.0}
2026-03-30 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW53628') HTTP/1.1" 204 0
2026-03-30 12:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV64764> (referer: https://www.auto1.com/v1/car-details-view/KV64764/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae111b05-b25d-5a72-8b32-7d200fb2fcd3 with identifier: KV64764
2026-03-30 12:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae111b05-b25d-5a72-8b32-7d200fb2fcd3 with scrape type 1
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ae111b05-b25d-5a72-8b32-7d200fb2fcd3
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_d523c2667df06006fe9fe81711e237a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_d523c2667df06006fe9fe81711e237a8.jpg already downloaded
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_9fddacc53c985cfabd8b4765d5dbfadd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_9fddacc53c985cfabd8b4765d5dbfadd.jpg already downloaded
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_dd6701963affab2f889b364f0581398c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_dd6701963affab2f889b364f0581398c.jpg already downloaded
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_82777fc4d86e388a9efaaf0fd3e829ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_82777fc4d86e388a9efaaf0fd3e829ef.jpg already downloaded
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_b4a8f494b1ab6e371f93184f3d3c7243.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_b4a8f494b1ab6e371f93184f3d3c7243.jpg already downloaded
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F10%252F6710e277bfdc6692de67ae30f7089298%252Fpa%252FKV64764_ef72253ab32445460ce4c71cffad15b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_ef72253ab32445460ce4c71cffad15b5.jpg already downloaded
2026-03-30 12:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae111b05-b25d-5a72-8b32-7d200fb2fcd3, identifier: KV64764
2026-03-30 12:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae111b05-b25d-5a72-8b32-7d200fb2fcd3 with identifier: KV64764
2026-03-30 12:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae111b05-b25d-5a72-8b32-7d200fb2fcd3 with identifier: KV64764
2026-03-30 12:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae111b05-b25d-5a72-8b32-7d200fb2fcd3 with identifier: KV64764 to the API
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV64764>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:31:50Z',
'fuel_type': 'petrol',
'id': 'ae111b05-b25d-5a72-8b32-7d200fb2fcd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV64764',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 199100,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_d523c2667df06006fe9fe81711e237a8.jpg',
'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_9fddacc53c985cfabd8b4765d5dbfadd.jpg',
'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_dd6701963affab2f889b364f0581398c.jpg',
'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_82777fc4d86e388a9efaaf0fd3e829ef.jpg',
'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_b4a8f494b1ab6e371f93184f3d3c7243.jpg',
'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_ef72253ab32445460ce4c71cffad15b5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_d523c2667df06006fe9fe81711e237a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_9fddacc53c985cfabd8b4765d5dbfadd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_dd6701963affab2f889b364f0581398c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_82777fc4d86e388a9efaaf0fd3e829ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_b4a8f494b1ab6e371f93184f3d3c7243.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae111b05-b25d-5a72-8b32-7d200fb2fcd3/ae111b05-b25d-5a72-8b32-7d200fb2fcd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/10/6710e277bfdc6692de67ae30f7089298/pa/KV64764_ef72253ab32445460ce4c71cffad15b5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV64764%27 HTTP/1.1" 200 None
2026-03-30 12:04:24 [auto1.fr] INFO: Saving data for KV64764: {'created_time': 1774872264.618159, 'last_price_update_time': 1774872264.618169, 'auction_closing_time': 1774971110.0}
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV64764') HTTP/1.1" 204 0
2026-03-30 12:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:25 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 5698 | hits on page: 40
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 12:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: CN71105
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: EF37210
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: BR75524
2026-03-30 12:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR75524%27 HTTP/1.1" 200 None
2026-03-30 12:04:25 [auto1.fr] INFO: Scrape type for BR75524: 1
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: BH81493
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: AC83389
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: RP10604
2026-03-30 12:04:25 [auto1.fr] INFO: Found listing with ID: SY05693
2026-03-30 12:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY05693%27 HTTP/1.1" 200 None
2026-03-30 12:04:25 [auto1.fr] INFO: Scrape type for SY05693: 2
2026-03-30 12:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc2cba5-0672-547b-9079-8b5e5d28b440 with identifier: SY05693
2026-03-30 12:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc2cba5-0672-547b-9079-8b5e5d28b440 with scrape type 2
2026-03-30 12:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc2cba5-0672-547b-9079-8b5e5d28b440 with scrape type 2
2026-03-30 12:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4cc2cba5-0672-547b-9079-8b5e5d28b440, identifier: SY05693
2026-03-30 12:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4cc2cba5-0672-547b-9079-8b5e5d28b440 with identifier: SY05693
2026-03-30 12:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4cc2cba5-0672-547b-9079-8b5e5d28b440 with identifier: SY05693
2026-03-30 12:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4cc2cba5-0672-547b-9079-8b5e5d28b440 with identifier: SY05693 to the API
2026-03-30 12:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:48:18Z',
'fuel_type': 'petrol',
'id': '4cc2cba5-0672-547b-9079-8b5e5d28b440',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY05693',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 87321,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-20',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY05693%27 HTTP/1.1" 200 None
2026-03-30 12:04:26 [auto1.fr] INFO: Saving data for SY05693: {'auction_closing_time': 1774972098.0, 'created_time': 1774299566.290401, 'last_price_update_time': 1774872266.25437}
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SY05693') HTTP/1.1" 204 0
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: LD59929
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: XY40736
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: WS97350
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: TL58072
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: KX79018
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: BH39999
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH39999%27 HTTP/1.1" 200 None
2026-03-30 12:04:26 [auto1.fr] INFO: Scrape type for BH39999: 2
2026-03-30 12:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with identifier: BH39999
2026-03-30 12:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with scrape type 2
2026-03-30 12:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with scrape type 2
2026-03-30 12:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 506aaccd-be0d-57e8-8053-7d9c7f8aa450, identifier: BH39999
2026-03-30 12:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with identifier: BH39999
2026-03-30 12:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with identifier: BH39999
2026-03-30 12:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 506aaccd-be0d-57e8-8053-7d9c7f8aa450 with identifier: BH39999 to the API
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:55:07Z',
'fuel_type': 'petrol',
'id': '506aaccd-be0d-57e8-8053-7d9c7f8aa450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH39999',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 129014,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-19',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 VTi SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2008}
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH39999%27 HTTP/1.1" 200 None
2026-03-30 12:04:26 [auto1.fr] INFO: Saving data for BH39999: {'auction_closing_time': 1774972507.0, 'created_time': 1773665793.462426, 'last_price_update_time': 1774872266.793386}
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH39999') HTTP/1.1" 204 0
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: NH49785
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: CV88444
2026-03-30 12:04:26 [auto1.fr] INFO: Found listing with ID: NY83999
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY83999%27 HTTP/1.1" 200 None
2026-03-30 12:04:26 [auto1.fr] INFO: Scrape type for NY83999: 2
2026-03-30 12:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-03-30 12:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd49b8f-1557-50d6-a08a-a4ba1406342f with scrape type 2
2026-03-30 12:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd49b8f-1557-50d6-a08a-a4ba1406342f with scrape type 2
2026-03-30 12:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bd49b8f-1557-50d6-a08a-a4ba1406342f, identifier: NY83999
2026-03-30 12:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-03-30 12:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-03-30 12:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999 to the API
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:25:52Z',
'fuel_type': 'diesel',
'id': '2bd49b8f-1557-50d6-a08a-a4ba1406342f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY83999',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 91045,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2021}
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY83999%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Saving data for NY83999: {'auction_closing_time': 1774970752.0, 'created_time': 1774299063.802001, 'last_price_update_time': 1774872267.259705}
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY83999') HTTP/1.1" 204 0
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: MC89388
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: EG50461
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG50461%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Scrape type for EG50461: 2
2026-03-30 12:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with identifier: EG50461
2026-03-30 12:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with scrape type 2
2026-03-30 12:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with scrape type 2
2026-03-30 12:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cbba1c56-7d76-562b-ace9-f5da32aa8eb8, identifier: EG50461
2026-03-30 12:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with identifier: EG50461
2026-03-30 12:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with identifier: EG50461
2026-03-30 12:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cbba1c56-7d76-562b-ace9-f5da32aa8eb8 with identifier: EG50461 to the API
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:48:46Z',
'fuel_type': 'petrol',
'id': 'cbba1c56-7d76-562b-ace9-f5da32aa8eb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG50461',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 93556,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-28',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG50461%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Saving data for EG50461: {'auction_closing_time': 1774972126.0, 'created_time': 1774270300.759371, 'last_price_update_time': 1774872267.802059}
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EG50461') HTTP/1.1" 204 0
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: BU50680
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: PR53320
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR53320%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Scrape type for PR53320: 1
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: NT01211
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: SJ86891
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: GV14574
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: ZP24027
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: YP42607
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: CR02968
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: SD98356
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD98356%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Scrape type for SD98356: 1
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: CC91432
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: MF38303
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF38303%27 HTTP/1.1" 200 None
2026-03-30 12:04:27 [auto1.fr] INFO: Scrape type for MF38303: 1
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: WZ42856
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: ED93860
2026-03-30 12:04:27 [auto1.fr] INFO: Found listing with ID: RW88857
2026-03-30 12:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US33536> (referer: https://www.auto1.com/v1/car-details-view/US33536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2 with identifier: US33536
2026-03-30 12:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2 with scrape type 1
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_542435d42124619dfc8486a21a2a62a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_542435d42124619dfc8486a21a2a62a1.jpg already downloaded
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_9b25fa60d03ea69aa18c7e6cbe83b83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9b25fa60d03ea69aa18c7e6cbe83b83d.jpg already downloaded
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_96d24d2a18eaa07213b59d5376d81765.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_96d24d2a18eaa07213b59d5376d81765.jpg already downloaded
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_17e114ab30da743c3b9c1423f5662477.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_17e114ab30da743c3b9c1423f5662477.jpg already downloaded
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_9be933ad52f4b101c339215eda29e5de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9be933ad52f4b101c339215eda29e5de.jpg already downloaded
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb5%252F0bb59966cb870c8df603a5ad4bec9ac2%252Fpa%252FUS33536_913ddc18e7a80caa27e1baa681364a45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_913ddc18e7a80caa27e1baa681364a45.jpg already downloaded
2026-03-30 12:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2, identifier: US33536
2026-03-30 12:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2 with identifier: US33536
2026-03-30 12:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2 with identifier: US33536
2026-03-30 12:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91c4187d-a262-52b8-9fcb-e39ff6cbd3d2 with identifier: US33536 to the API
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US33536>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:42:53Z',
'fuel_type': 'diesel',
'id': '91c4187d-a262-52b8-9fcb-e39ff6cbd3d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US33536',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 241324,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_542435d42124619dfc8486a21a2a62a1.jpg',
'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9b25fa60d03ea69aa18c7e6cbe83b83d.jpg',
'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_96d24d2a18eaa07213b59d5376d81765.jpg',
'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_17e114ab30da743c3b9c1423f5662477.jpg',
'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9be933ad52f4b101c339215eda29e5de.jpg',
'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_913ddc18e7a80caa27e1baa681364a45.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_542435d42124619dfc8486a21a2a62a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9b25fa60d03ea69aa18c7e6cbe83b83d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_96d24d2a18eaa07213b59d5376d81765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_17e114ab30da743c3b9c1423f5662477.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_9be933ad52f4b101c339215eda29e5de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c4187d-a262-52b8-9fcb-e39ff6cbd3d2/91c4187d-a262-52b8-9fcb-e39ff6cbd3d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b5/0bb59966cb870c8df603a5ad4bec9ac2/pa/US33536_913ddc18e7a80caa27e1baa681364a45.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi ASX 1.8 DI-D Invite 2WD',
'transmission': 'manual',
'trim': 'Invite 2WD',
'year': 2011}
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US33536%27 HTTP/1.1" 200 None
2026-03-30 12:04:29 [auto1.fr] INFO: Saving data for US33536: {'created_time': 1774872269.997564, 'last_price_update_time': 1774872269.997573, 'auction_closing_time': 1774971773.0}
2026-03-30 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US33536') HTTP/1.1" 204 0
2026-03-30 12:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD05878> (referer: https://www.auto1.com/v1/car-details-view/CD05878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad0ad135-0cd3-54ad-9252-dadfd6309f10 with identifier: CD05878
2026-03-30 12:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad0ad135-0cd3-54ad-9252-dadfd6309f10 with scrape type 1
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad0ad135-0cd3-54ad-9252-dadfd6309f10
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_bc8c7eb6d966e0c513269fa0bfd21143.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_bc8c7eb6d966e0c513269fa0bfd21143.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_1467824d1ad26dbcc4db493d059d8c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1467824d1ad26dbcc4db493d059d8c89.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_627665695987668d4bf62463bf95abcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_627665695987668d4bf62463bf95abcf.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_45f7e15559c4e4fabe98ebe62fabb877.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_45f7e15559c4e4fabe98ebe62fabb877.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_13c0141fccf462d10ec42d4036c365d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_13c0141fccf462d10ec42d4036c365d9.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_b4b587929f4da926ebe941cf370edb0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_b4b587929f4da926ebe941cf370edb0c.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_5d7e8547f66ac8a40172031502829340.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_5d7e8547f66ac8a40172031502829340.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_1040be447439f30380a20816d6ddca29.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1040be447439f30380a20816d6ddca29.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_1cdda3de8943fcc48cb0f0b188a7b65b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1cdda3de8943fcc48cb0f0b188a7b65b.jpg already downloaded
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F92%252F9892c7c51edf3f7ec7953fcd2edc2806%252Fpa%252FCD05878_64674f0951c04397f49550b9317f6f97.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_64674f0951c04397f49550b9317f6f97.jpg already downloaded
2026-03-30 12:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad0ad135-0cd3-54ad-9252-dadfd6309f10, identifier: CD05878
2026-03-30 12:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad0ad135-0cd3-54ad-9252-dadfd6309f10 with identifier: CD05878
2026-03-30 12:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad0ad135-0cd3-54ad-9252-dadfd6309f10 with identifier: CD05878
2026-03-30 12:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad0ad135-0cd3-54ad-9252-dadfd6309f10 with identifier: CD05878 to the API
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD05878>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 173,
'expiration_date': '2026-03-31T15:28:07Z',
'fuel_type': 'diesel',
'id': 'ad0ad135-0cd3-54ad-9252-dadfd6309f10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD05878',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Renault',
'model': 'Laguna',
'odometer': 170971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_bc8c7eb6d966e0c513269fa0bfd21143.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1467824d1ad26dbcc4db493d059d8c89.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_627665695987668d4bf62463bf95abcf.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_45f7e15559c4e4fabe98ebe62fabb877.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_13c0141fccf462d10ec42d4036c365d9.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_b4b587929f4da926ebe941cf370edb0c.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_5d7e8547f66ac8a40172031502829340.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1040be447439f30380a20816d6ddca29.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1cdda3de8943fcc48cb0f0b188a7b65b.jpg',
'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_64674f0951c04397f49550b9317f6f97.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_bc8c7eb6d966e0c513269fa0bfd21143.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1467824d1ad26dbcc4db493d059d8c89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_627665695987668d4bf62463bf95abcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_45f7e15559c4e4fabe98ebe62fabb877.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_13c0141fccf462d10ec42d4036c365d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_b4b587929f4da926ebe941cf370edb0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_5d7e8547f66ac8a40172031502829340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1040be447439f30380a20816d6ddca29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_1cdda3de8943fcc48cb0f0b188a7b65b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0ad135-0cd3-54ad-9252-dadfd6309f10/ad0ad135-0cd3-54ad-9252-dadfd6309f10_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/92/9892c7c51edf3f7ec7953fcd2edc2806/pa/CD05878_64674f0951c04397f49550b9317f6f97.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-05-19',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Monaco GP',
'transmission': 'manual',
'trim': 'Monaco GP',
'year': 2015}
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD05878%27 HTTP/1.1" 200 None
2026-03-30 12:04:39 [auto1.fr] INFO: Saving data for CD05878: {'created_time': 1774872279.456573, 'last_price_update_time': 1774872279.456584, 'auction_closing_time': 1774970887.0}
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD05878') HTTP/1.1" 204 0
2026-03-30 12:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR75524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD98356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR53320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF38303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN00368> (referer: https://www.auto1.com/v1/car-details-view/DN00368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835bf55d-7a1c-5a83-91da-5a1ed1352a6d with identifier: DN00368
2026-03-30 12:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835bf55d-7a1c-5a83-91da-5a1ed1352a6d with scrape type 1
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 835bf55d-7a1c-5a83-91da-5a1ed1352a6d
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_091fb5faf5ab7e6a26cf526ace215bcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_091fb5faf5ab7e6a26cf526ace215bcf.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_2334dbc4bfe35eee189e83372894099d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_2334dbc4bfe35eee189e83372894099d.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_67b03baa50ccabf08119aa2c8ea075a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_67b03baa50ccabf08119aa2c8ea075a4.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_fa212b7273c2676d1e0e34f576d9f387.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_fa212b7273c2676d1e0e34f576d9f387.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_abd4798a2c1487004772b8eeea8a6987.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_abd4798a2c1487004772b8eeea8a6987.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_b4be81394ef5cd313fb7a313325c6d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_b4be81394ef5cd313fb7a313325c6d10.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_247d23a35c6156b8a02e536db548a8ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_247d23a35c6156b8a02e536db548a8ed.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_ecab85943b07813dc88c1a5b8058e97d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_ecab85943b07813dc88c1a5b8058e97d.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_f57542970674ea5cea936fb6ae2f0eaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_f57542970674ea5cea936fb6ae2f0eaf.jpg already downloaded
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fbf%252F2fbf97c1d4d7943f7032be437749fa87%252Fpa%252FDN00368_427f1b38dea4b4953c4f4eeac88f7c25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_427f1b38dea4b4953c4f4eeac88f7c25.jpg already downloaded
2026-03-30 12:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 835bf55d-7a1c-5a83-91da-5a1ed1352a6d, identifier: DN00368
2026-03-30 12:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 835bf55d-7a1c-5a83-91da-5a1ed1352a6d with identifier: DN00368
2026-03-30 12:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 835bf55d-7a1c-5a83-91da-5a1ed1352a6d with identifier: DN00368
2026-03-30 12:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 835bf55d-7a1c-5a83-91da-5a1ed1352a6d with identifier: DN00368 to the API
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN00368>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:22:12Z',
'fuel_type': 'diesel',
'id': '835bf55d-7a1c-5a83-91da-5a1ed1352a6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN00368',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Audi',
'model': 'Q3',
'odometer': 209048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_091fb5faf5ab7e6a26cf526ace215bcf.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_2334dbc4bfe35eee189e83372894099d.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_67b03baa50ccabf08119aa2c8ea075a4.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_fa212b7273c2676d1e0e34f576d9f387.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_abd4798a2c1487004772b8eeea8a6987.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_b4be81394ef5cd313fb7a313325c6d10.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_247d23a35c6156b8a02e536db548a8ed.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_ecab85943b07813dc88c1a5b8058e97d.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_f57542970674ea5cea936fb6ae2f0eaf.jpg',
'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_427f1b38dea4b4953c4f4eeac88f7c25.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_091fb5faf5ab7e6a26cf526ace215bcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_2334dbc4bfe35eee189e83372894099d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_67b03baa50ccabf08119aa2c8ea075a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_fa212b7273c2676d1e0e34f576d9f387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_abd4798a2c1487004772b8eeea8a6987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_b4be81394ef5cd313fb7a313325c6d10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_247d23a35c6156b8a02e536db548a8ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_ecab85943b07813dc88c1a5b8058e97d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_f57542970674ea5cea936fb6ae2f0eaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835bf55d-7a1c-5a83-91da-5a1ed1352a6d/835bf55d-7a1c-5a83-91da-5a1ed1352a6d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/bf/2fbf97c1d4d7943f7032be437749fa87/pa/DN00368_427f1b38dea4b4953c4f4eeac88f7c25.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 2.0 TDI S line',
'transmission': 'manual',
'trim': 'S line',
'year': 2016}
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN00368%27 HTTP/1.1" 200 None
2026-03-30 12:04:48 [auto1.fr] INFO: Saving data for DN00368: {'created_time': 1774872288.290438, 'last_price_update_time': 1774872288.29045, 'auction_closing_time': 1774970532.0}
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DN00368') HTTP/1.1" 204 0
2026-03-30 12:04:48 [scrapy.extensions.logstats] INFO: Crawled 60 pages (at 21 pages/min), scraped 49 items (at 15 items/min)
2026-03-30 12:04:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR53320> (referer: https://www.auto1.com/v1/car-details-view/PR53320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866bfccd-30dc-5ec4-b244-84648ec094b3 with identifier: PR53320
2026-03-30 12:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866bfccd-30dc-5ec4-b244-84648ec094b3 with scrape type 1
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 866bfccd-30dc-5ec4-b244-84648ec094b3
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_e9da5a78d126c842a654fa573bc8622b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_e9da5a78d126c842a654fa573bc8622b.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_4952a5f71599fc2ac48f55d8522fb047.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_4952a5f71599fc2ac48f55d8522fb047.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_376b34064afda5c68d9e5e79c34ec8f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_376b34064afda5c68d9e5e79c34ec8f6.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_df759eb94033fb5b85547c7018daa788.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_df759eb94033fb5b85547c7018daa788.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_18cd6e0107a959b3d2745da287f26a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_18cd6e0107a959b3d2745da287f26a4a.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_fdf61640b41cf5ded023a573bb4f537e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_fdf61640b41cf5ded023a573bb4f537e.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_1c4ac60e7de0007535d7ad441a075224.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_1c4ac60e7de0007535d7ad441a075224.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_d365fcbca865379386878d8b851499fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_d365fcbca865379386878d8b851499fd.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_2f84f20057ae79929ed4b032d3348d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_2f84f20057ae79929ed4b032d3348d26.jpg already downloaded
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fb6%252F51b6e6771f92d2e3cb4573a3a9f00aa4%252Fpa%252FPR53320_3e76345492410ff7823261f363b0783f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_3e76345492410ff7823261f363b0783f.jpg already downloaded
2026-03-30 12:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 866bfccd-30dc-5ec4-b244-84648ec094b3, identifier: PR53320
2026-03-30 12:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 866bfccd-30dc-5ec4-b244-84648ec094b3 with identifier: PR53320
2026-03-30 12:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 866bfccd-30dc-5ec4-b244-84648ec094b3 with identifier: PR53320
2026-03-30 12:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 866bfccd-30dc-5ec4-b244-84648ec094b3 with identifier: PR53320 to the API
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR53320>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-03-31T15:00:03Z',
'fuel_type': 'petrol',
'id': '866bfccd-30dc-5ec4-b244-84648ec094b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR53320',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 2802,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_e9da5a78d126c842a654fa573bc8622b.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_4952a5f71599fc2ac48f55d8522fb047.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_376b34064afda5c68d9e5e79c34ec8f6.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_df759eb94033fb5b85547c7018daa788.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_18cd6e0107a959b3d2745da287f26a4a.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_fdf61640b41cf5ded023a573bb4f537e.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_1c4ac60e7de0007535d7ad441a075224.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_d365fcbca865379386878d8b851499fd.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_2f84f20057ae79929ed4b032d3348d26.jpg',
'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_3e76345492410ff7823261f363b0783f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_e9da5a78d126c842a654fa573bc8622b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_4952a5f71599fc2ac48f55d8522fb047.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_376b34064afda5c68d9e5e79c34ec8f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_df759eb94033fb5b85547c7018daa788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_18cd6e0107a959b3d2745da287f26a4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3108828,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_fdf61640b41cf5ded023a573bb4f537e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3103478,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_1c4ac60e7de0007535d7ad441a075224.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2981098,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_d365fcbca865379386878d8b851499fd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_2f84f20057ae79929ed4b032d3348d26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866bfccd-30dc-5ec4-b244-84648ec094b3/866bfccd-30dc-5ec4-b244-84648ec094b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/b6/51b6e6771f92d2e3cb4573a3a9f00aa4/pa/PR53320_3e76345492410ff7823261f363b0783f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-01-25',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 VVT-i Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2024}
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR53320%27 HTTP/1.1" 200 None
2026-03-30 12:04:49 [auto1.fr] INFO: Saving data for PR53320: {'created_time': 1774872289.964022, 'last_price_update_time': 1774872289.964035, 'auction_closing_time': 1774969203.0}
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR53320') HTTP/1.1" 204 0
2026-03-30 12:04:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.798(s), this was the 1st time calling it.
2026-03-30 12:04:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.756736557060515 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF38303> (referer: https://www.auto1.com/v1/car-details-view/MF38303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b905596-e29d-5940-95fe-109f468ea944 with identifier: MF38303
2026-03-30 12:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b905596-e29d-5940-95fe-109f468ea944 with scrape type 1
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b905596-e29d-5940-95fe-109f468ea944
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_fba1290e7e5756ba13e59822f3cba723.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_fba1290e7e5756ba13e59822f3cba723.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_d5a3f93bbed1e5fc4f7733a7cf75308a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d5a3f93bbed1e5fc4f7733a7cf75308a.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_f5423b68cb4ad9634e012c39d392214f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_f5423b68cb4ad9634e012c39d392214f.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_9f6ed1f251cf0a574a67bc12566d569c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_9f6ed1f251cf0a574a67bc12566d569c.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_06d5e20fe7984b54aea6376764adadb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_06d5e20fe7984b54aea6376764adadb5.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_081adfc3be6cadfbdca4f53c0f7c9db4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_081adfc3be6cadfbdca4f53c0f7c9db4.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_d4b11305a7358a6416005944e498e947.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d4b11305a7358a6416005944e498e947.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_af0fb81a84192913576d7cc5e2caf6f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_af0fb81a84192913576d7cc5e2caf6f9.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_ce32f52201799c3a94491cb30b16fb80.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_ce32f52201799c3a94491cb30b16fb80.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F35%252F65359a60467cdd40532e0169dc2c9d75%252Fpa%252FMF38303_a4d9f566954af4b6e13148c021c98775.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_a4d9f566954af4b6e13148c021c98775.jpg already downloaded
2026-03-30 12:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b905596-e29d-5940-95fe-109f468ea944, identifier: MF38303
2026-03-30 12:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b905596-e29d-5940-95fe-109f468ea944 with identifier: MF38303
2026-03-30 12:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b905596-e29d-5940-95fe-109f468ea944 with identifier: MF38303
2026-03-30 12:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b905596-e29d-5940-95fe-109f468ea944 with identifier: MF38303 to the API
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MF38303>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:47:11Z',
'fuel_type': 'petrol',
'id': '4b905596-e29d-5940-95fe-109f468ea944',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF38303',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 104185,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_fba1290e7e5756ba13e59822f3cba723.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d5a3f93bbed1e5fc4f7733a7cf75308a.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_f5423b68cb4ad9634e012c39d392214f.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_9f6ed1f251cf0a574a67bc12566d569c.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_06d5e20fe7984b54aea6376764adadb5.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_081adfc3be6cadfbdca4f53c0f7c9db4.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d4b11305a7358a6416005944e498e947.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_af0fb81a84192913576d7cc5e2caf6f9.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_ce32f52201799c3a94491cb30b16fb80.jpg',
'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_a4d9f566954af4b6e13148c021c98775.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_fba1290e7e5756ba13e59822f3cba723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d5a3f93bbed1e5fc4f7733a7cf75308a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3060640,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_f5423b68cb4ad9634e012c39d392214f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3199721,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_9f6ed1f251cf0a574a67bc12566d569c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2855069,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_06d5e20fe7984b54aea6376764adadb5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3003649,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_081adfc3be6cadfbdca4f53c0f7c9db4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_d4b11305a7358a6416005944e498e947.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_af0fb81a84192913576d7cc5e2caf6f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_ce32f52201799c3a94491cb30b16fb80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b905596-e29d-5940-95fe-109f468ea944/4b905596-e29d-5940-95fe-109f468ea944_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/35/65359a60467cdd40532e0169dc2c9d75/pa/MF38303_a4d9f566954af4b6e13148c021c98775.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2018}
2026-03-30 12:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF38303%27 HTTP/1.1" 200 None
2026-03-30 12:04:52 [auto1.fr] INFO: Saving data for MF38303: {'created_time': 1774872292.087652, 'last_price_update_time': 1774872292.087664, 'auction_closing_time': 1774972031.0}
2026-03-30 12:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF38303') HTTP/1.1" 204 0
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD98356> (referer: https://www.auto1.com/v1/car-details-view/SD98356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-03-30 12:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a337ac9-a885-5106-a620-c538fe5d548a with scrape type 1
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_f0df9c10085491c7c105fec113cca495.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_4d172216a872018fb2d6b30ee0331f82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_fc6d9f8b5c597989679168995e93112e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg not downloaded yet
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_b88ee878278ce12a6eb2d01049591fbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg not downloaded yet
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg not downloaded yet
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_be41fea463650ff239689b6187d00bf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg not downloaded yet
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f8b10>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2fbe50>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_4d172216a872018fb2d6b30ee0331f82.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1453d0>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac76e10>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_f0df9c10085491c7c105fec113cca495.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ce190>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15f9d0>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_fc6d9f8b5c597989679168995e93112e.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefdd296590>
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg saved to cache
2026-03-30 12:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca144710>
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_b88ee878278ce12a6eb2d01049591fbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg saved to cache
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c6fd0>
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_be41fea463650ff239689b6187d00bf6.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg saved to cache
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ecc10>
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9f%252F779fc227974df518885145419d8f7c06%252Fpa%252FSD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg saved to cache
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-03-30 12:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a337ac9-a885-5106-a620-c538fe5d548a, skipping ID generation
2026-03-30 12:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a337ac9-a885-5106-a620-c538fe5d548a with scrape type 1
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a337ac9-a885-5106-a620-c538fe5d548a sending to next pipeline
2026-03-30 12:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a337ac9-a885-5106-a620-c538fe5d548a, identifier: SD98356
2026-03-30 12:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-03-30 12:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-03-30 12:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356 to the API
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:07:56Z',
'fuel_type': 'diesel',
'id': '9a337ac9-a885-5106-a620-c538fe5d548a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD98356',
'listing': 'auction',
'location': 'FR, Saint-Maur-des-Fossés',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 256564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD98356%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [auto1.fr] INFO: Saving data for SD98356: {'created_time': 1774872295.700275, 'last_price_update_time': 1774872295.700286, 'auction_closing_time': 1774969676.0}
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SD98356') HTTP/1.1" 204 0
2026-03-30 12:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR75524> (referer: https://www.auto1.com/v1/car-details-view/BR75524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7130885b-def8-57ed-b2a0-304357dd82f5 with identifier: BR75524
2026-03-30 12:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7130885b-def8-57ed-b2a0-304357dd82f5 with scrape type 1
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_09dcfc791642cd9135d1e4fc283ab254.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_09dcfc791642cd9135d1e4fc283ab254.jpg not downloaded yet
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg not downloaded yet
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_47c5c310256148724aaf47d580b7adea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_47c5c310256148724aaf47d580b7adea.jpg not downloaded yet
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg not downloaded yet
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_9cd9d78865ab3a10823a0d687073caad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_9cd9d78865ab3a10823a0d687073caad.jpg not downloaded yet
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg not downloaded yet
2026-03-30 12:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_09dcfc791642cd9135d1e4fc283ab254.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_590ada11ca3ffafc0b5fab541a459580.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_590ada11ca3ffafc0b5fab541a459580.jpg not downloaded yet
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg not downloaded yet
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_8bc44069c856445fb96d3f515b366112.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8bc44069c856445fb96d3f515b366112.jpg not downloaded yet
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_ef45059e2bc928c88a9184538877aa46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ef45059e2bc928c88a9184538877aa46.jpg not downloaded yet
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bc590>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_09dcfc791642cd9135d1e4fc283ab254.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_09dcfc791642cd9135d1e4fc283ab254.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_590ada11ca3ffafc0b5fab541a459580.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8bc44069c856445fb96d3f515b366112.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca294210>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1040d0>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dde50>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ef45059e2bc928c88a9184538877aa46.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc5110>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca155110>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_590ada11ca3ffafc0b5fab541a459580.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_590ada11ca3ffafc0b5fab541a459580.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2415d0>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_8bc44069c856445fb96d3f515b366112.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8bc44069c856445fb96d3f515b366112.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16e550>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_ef45059e2bc928c88a9184538877aa46.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ef45059e2bc928c88a9184538877aa46.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_47c5c310256148724aaf47d580b7adea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_9cd9d78865ab3a10823a0d687073caad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e30d0>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_47c5c310256148724aaf47d580b7adea.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_47c5c310256148724aaf47d580b7adea.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ca850>
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd6bcbb931f9f7f36e128f4eb589f9%252Fpa%252FBR75524_9cd9d78865ab3a10823a0d687073caad.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_9cd9d78865ab3a10823a0d687073caad.jpg saved to cache
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7130885b-def8-57ed-b2a0-304357dd82f5
2026-03-30 12:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7130885b-def8-57ed-b2a0-304357dd82f5, skipping ID generation
2026-03-30 12:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7130885b-def8-57ed-b2a0-304357dd82f5 with scrape type 1
2026-03-30 12:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7130885b-def8-57ed-b2a0-304357dd82f5 sending to next pipeline
2026-03-30 12:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7130885b-def8-57ed-b2a0-304357dd82f5, identifier: BR75524
2026-03-30 12:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7130885b-def8-57ed-b2a0-304357dd82f5 with identifier: BR75524
2026-03-30 12:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7130885b-def8-57ed-b2a0-304357dd82f5 with identifier: BR75524
2026-03-30 12:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7130885b-def8-57ed-b2a0-304357dd82f5 with identifier: BR75524 to the API
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_9cd9d78865ab3a10823a0d687073caad.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:53:06Z',
'fuel_type': 'petrol',
'id': '7130885b-def8-57ed-b2a0-304357dd82f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR75524',
'listing': 'auction',
'location': 'FR, Herblay',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 78657,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_09dcfc791642cd9135d1e4fc283ab254.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8ba72563216ce9fb9512664bd4ea4a57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2305969,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_47c5c310256148724aaf47d580b7adea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ed39cb9b77a7438d6827eadb9d0479dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2350490,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_9cd9d78865ab3a10823a0d687073caad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_3b23c87adfaa2098486eaa4c02e19b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_590ada11ca3ffafc0b5fab541a459580.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_aeafd45ebf35bf783f8610fe45cf563f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_8bc44069c856445fb96d3f515b366112.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7130885b-def8-57ed-b2a0-304357dd82f5/7130885b-def8-57ed-b2a0-304357dd82f5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd6bcbb931f9f7f36e128f4eb589f9/pa/BR75524_ef45059e2bc928c88a9184538877aa46.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Sunshine',
'transmission': 'manual',
'trim': 'Sunshine',
'year': 2018}
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR75524%27 HTTP/1.1" 200 None
2026-03-30 12:04:57 [auto1.fr] INFO: Saving data for BR75524: {'created_time': 1774872297.307779, 'last_price_update_time': 1774872297.307795, 'auction_closing_time': 1774972386.0}
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR75524') HTTP/1.1" 204 0
2026-03-30 12:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF01831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF01831> (referer: https://www.auto1.com/v1/car-details-view/LF01831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8a6c0d-7413-5210-9e50-455dc9927595 with identifier: LF01831
2026-03-30 12:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a6c0d-7413-5210-9e50-455dc9927595 with scrape type 1
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_2bce6488c87faa57cda2a9164d8f182b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_2bce6488c87faa57cda2a9164d8f182b.jpg not downloaded yet
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_08a72dd6faa664a2d2631282991466f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_08a72dd6faa664a2d2631282991466f2.jpg not downloaded yet
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_497087b8bbe8039a657dabd13b2826fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_497087b8bbe8039a657dabd13b2826fb.jpg not downloaded yet
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg not downloaded yet
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_3df3a1c93c83574a41b056bdb36b9461.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_3df3a1c93c83574a41b056bdb36b9461.jpg not downloaded yet
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_d57888a59360040d20f982bc71aec75f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_d57888a59360040d20f982bc71aec75f.jpg not downloaded yet
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_2bce6488c87faa57cda2a9164d8f182b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_497087b8bbe8039a657dabd13b2826fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a1910>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_2bce6488c87faa57cda2a9164d8f182b.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_2bce6488c87faa57cda2a9164d8f182b.jpg saved to cache
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca148f50>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_497087b8bbe8039a657dabd13b2826fb.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_497087b8bbe8039a657dabd13b2826fb.jpg saved to cache
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_d57888a59360040d20f982bc71aec75f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_3df3a1c93c83574a41b056bdb36b9461.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_08a72dd6faa664a2d2631282991466f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e7b10>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_d57888a59360040d20f982bc71aec75f.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_d57888a59360040d20f982bc71aec75f.jpg saved to cache
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca145350>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_3df3a1c93c83574a41b056bdb36b9461.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_3df3a1c93c83574a41b056bdb36b9461.jpg saved to cache
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1772d0>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_08a72dd6faa664a2d2631282991466f2.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_08a72dd6faa664a2d2631282991466f2.jpg saved to cache
2026-03-30 12:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e78d0>
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F80%252F6a808f0051c90ed7491f05f6cb378ac1%252Fpa%252FLF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg saved to cache
2026-03-30 12:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b8a6c0d-7413-5210-9e50-455dc9927595
2026-03-30 12:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b8a6c0d-7413-5210-9e50-455dc9927595, skipping ID generation
2026-03-30 12:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a6c0d-7413-5210-9e50-455dc9927595 with scrape type 1
2026-03-30 12:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b8a6c0d-7413-5210-9e50-455dc9927595 sending to next pipeline
2026-03-30 12:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b8a6c0d-7413-5210-9e50-455dc9927595, identifier: LF01831
2026-03-30 12:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b8a6c0d-7413-5210-9e50-455dc9927595 with identifier: LF01831
2026-03-30 12:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b8a6c0d-7413-5210-9e50-455dc9927595 with identifier: LF01831
2026-03-30 12:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9b8a6c0d-7413-5210-9e50-455dc9927595 with identifier: LF01831 to the API
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:53:49Z',
'fuel_type': 'diesel',
'id': '9b8a6c0d-7413-5210-9e50-455dc9927595',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF01831',
'listing': 'auction',
'location': 'FR, Bourg-en-Bresse',
'make': 'Ford',
'model': 'Focus',
'odometer': 222792,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_2bce6488c87faa57cda2a9164d8f182b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_08a72dd6faa664a2d2631282991466f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_497087b8bbe8039a657dabd13b2826fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_b2fc45dd4abf0f6aeacfcfa62aea1812.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_3df3a1c93c83574a41b056bdb36b9461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a6c0d-7413-5210-9e50-455dc9927595/9b8a6c0d-7413-5210-9e50-455dc9927595_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/80/6a808f0051c90ed7491f05f6cb378ac1/pa/LF01831_d57888a59360040d20f982bc71aec75f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF01831%27 HTTP/1.1" 200 None
2026-03-30 12:05:02 [auto1.fr] INFO: Saving data for LF01831: {'created_time': 1774872302.525954, 'last_price_update_time': 1774872302.525966, 'auction_closing_time': 1774972429.0}
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF01831') HTTP/1.1" 204 0
2026-03-30 12:05:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.339(s), this was the 1st time calling it.
2026-03-30 12:05:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.910364198762873 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN56333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN56333> (referer: https://www.auto1.com/v1/car-details-view/VN56333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb1e37e-da21-5892-8ace-e62a1578c1bd with identifier: VN56333
2026-03-30 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb1e37e-da21-5892-8ace-e62a1578c1bd with scrape type 1
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item beb1e37e-da21-5892-8ace-e62a1578c1bd
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_6dfb2e7c60133715f99c9d4527ebe1d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6dfb2e7c60133715f99c9d4527ebe1d3.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_b7cce6781f1bd050150e63bd8c1c11fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_b7cce6781f1bd050150e63bd8c1c11fe.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_e69ab62bb64762c26f38545eb6e434d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_e69ab62bb64762c26f38545eb6e434d4.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_d4f66d51c505fe10e286c7e5c01862eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_d4f66d51c505fe10e286c7e5c01862eb.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_65106b57ad9342ec90853947c26e4d2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_65106b57ad9342ec90853947c26e4d2c.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_5ae12b5738e79e12cd6ec2e86113499e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5ae12b5738e79e12cd6ec2e86113499e.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_f10bb6c7652f87ad371bf88f69c9a73f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_f10bb6c7652f87ad371bf88f69c9a73f.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_3957b09058bc7cd55fea4ac95cddebec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_3957b09058bc7cd55fea4ac95cddebec.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_6db12da57ef2bdad5499c9fd0967832c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6db12da57ef2bdad5499c9fd0967832c.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370af0a307e078a259098e679abae311%252Fpa%252FVN56333_5981e3c0cc16bf0144d12e556656e55f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5981e3c0cc16bf0144d12e556656e55f.jpg already downloaded
2026-03-30 12:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: beb1e37e-da21-5892-8ace-e62a1578c1bd, identifier: VN56333
2026-03-30 12:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: beb1e37e-da21-5892-8ace-e62a1578c1bd with identifier: VN56333
2026-03-30 12:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: beb1e37e-da21-5892-8ace-e62a1578c1bd with identifier: VN56333
2026-03-30 12:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: beb1e37e-da21-5892-8ace-e62a1578c1bd with identifier: VN56333 to the API
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN56333>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:05:23Z',
'fuel_type': 'diesel',
'id': 'beb1e37e-da21-5892-8ace-e62a1578c1bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN56333',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'BMW',
'model': '1er',
'odometer': 95317,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6dfb2e7c60133715f99c9d4527ebe1d3.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_b7cce6781f1bd050150e63bd8c1c11fe.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_e69ab62bb64762c26f38545eb6e434d4.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_d4f66d51c505fe10e286c7e5c01862eb.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_65106b57ad9342ec90853947c26e4d2c.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5ae12b5738e79e12cd6ec2e86113499e.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_f10bb6c7652f87ad371bf88f69c9a73f.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_3957b09058bc7cd55fea4ac95cddebec.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6db12da57ef2bdad5499c9fd0967832c.jpg',
'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5981e3c0cc16bf0144d12e556656e55f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6dfb2e7c60133715f99c9d4527ebe1d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2346062,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_b7cce6781f1bd050150e63bd8c1c11fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_e69ab62bb64762c26f38545eb6e434d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2092207,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_d4f66d51c505fe10e286c7e5c01862eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_65106b57ad9342ec90853947c26e4d2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5ae12b5738e79e12cd6ec2e86113499e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_f10bb6c7652f87ad371bf88f69c9a73f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_3957b09058bc7cd55fea4ac95cddebec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2329639,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_6db12da57ef2bdad5499c9fd0967832c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb1e37e-da21-5892-8ace-e62a1578c1bd/beb1e37e-da21-5892-8ace-e62a1578c1bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370af0a307e078a259098e679abae311/pa/VN56333_5981e3c0cc16bf0144d12e556656e55f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d M Design',
'transmission': 'automatic',
'trim': 'M Design',
'year': 2021}
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN56333%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [auto1.fr] INFO: Saving data for VN56333: {'created_time': 1774872310.914195, 'last_price_update_time': 1774872310.914212, 'auction_closing_time': 1774969523.0}
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN56333') HTTP/1.1" 204 0
2026-03-30 12:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:30 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: UY14685
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: UN11275
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: LZ68007
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: PY98810
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: GM21063
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: UM27725
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: SZ69319
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: PZ99671
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: NS29326
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: KY08586
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY08586%27 HTTP/1.1" 200 None
2026-03-30 12:05:30 [auto1.fr] INFO: Scrape type for KY08586: 1
2026-03-30 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: CH55510
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH55510%27 HTTP/1.1" 200 None
2026-03-30 12:05:30 [auto1.fr] INFO: Scrape type for CH55510: 1
2026-03-30 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: JG04823
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: JT52746
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: RC08561
2026-03-30 12:05:30 [auto1.fr] INFO: Found listing with ID: YS81962
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS81962%27 HTTP/1.1" 200 None
2026-03-30 12:05:30 [auto1.fr] INFO: Scrape type for YS81962: 2
2026-03-30 12:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 007910de-3071-53c0-8cc5-4b628042af74 with identifier: YS81962
2026-03-30 12:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007910de-3071-53c0-8cc5-4b628042af74 with scrape type 2
2026-03-30 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 007910de-3071-53c0-8cc5-4b628042af74 with scrape type 2
2026-03-30 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 007910de-3071-53c0-8cc5-4b628042af74, identifier: YS81962
2026-03-30 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 007910de-3071-53c0-8cc5-4b628042af74 with identifier: YS81962
2026-03-30 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 007910de-3071-53c0-8cc5-4b628042af74 with identifier: YS81962
2026-03-30 12:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 007910de-3071-53c0-8cc5-4b628042af74 with identifier: YS81962 to the API
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:25:34Z',
'fuel_type': 'diesel',
'id': '007910de-3071-53c0-8cc5-4b628042af74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS81962',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 93174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-10',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TDI BlueMotion',
'transmission': 'manual',
'trim': 'BlueMotion',
'year': 2013}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS81962%27 HTTP/1.1" 200 None
2026-03-30 12:05:32 [auto1.fr] INFO: Saving data for YS81962: {'auction_closing_time': 1774970734.0, 'created_time': 1774268464.458287, 'last_price_update_time': 1774872332.655503}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS81962') HTTP/1.1" 204 0
2026-03-30 12:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: XL73746
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: SJ22403
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: NW68535
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: KA64045
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: ZD89512
2026-03-30 12:05:32 [auto1.fr] INFO: Found listing with ID: AG33226
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG33226%27 HTTP/1.1" 200 None
2026-03-30 12:05:32 [auto1.fr] INFO: Scrape type for AG33226: 2
2026-03-30 12:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f092f52a-06a8-5597-8ccf-7969afa2e2d5 with identifier: AG33226
2026-03-30 12:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f092f52a-06a8-5597-8ccf-7969afa2e2d5 with scrape type 2
2026-03-30 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f092f52a-06a8-5597-8ccf-7969afa2e2d5 with scrape type 2
2026-03-30 12:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f092f52a-06a8-5597-8ccf-7969afa2e2d5, identifier: AG33226
2026-03-30 12:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f092f52a-06a8-5597-8ccf-7969afa2e2d5 with identifier: AG33226
2026-03-30 12:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f092f52a-06a8-5597-8ccf-7969afa2e2d5 with identifier: AG33226
2026-03-30 12:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f092f52a-06a8-5597-8ccf-7969afa2e2d5 with identifier: AG33226 to the API
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:29:16Z',
'fuel_type': 'petrol',
'id': 'f092f52a-06a8-5597-8ccf-7969afa2e2d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG33226',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 102989,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2015}
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG33226%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Saving data for AG33226: {'auction_closing_time': 1774970956.0, 'created_time': 1774279251.250961, 'last_price_update_time': 1774872333.259159}
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AG33226') HTTP/1.1" 204 0
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: EV69519
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: ZC47446
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: MH84462
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH84462%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Scrape type for MH84462: 0
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: FW05670
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW05670%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Scrape type for FW05670: 1
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: YV12989
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: NW87362
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW87362%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Scrape type for NW87362: 1
2026-03-30 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: UY26535
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: NG50520
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: EJ12515
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: EB00923
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: AM99663
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM99663%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Scrape type for AM99663: 2
2026-03-30 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce609eb2-3a2f-55d8-aabc-08de0cdee792 with identifier: AM99663
2026-03-30 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce609eb2-3a2f-55d8-aabc-08de0cdee792 with scrape type 2
2026-03-30 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce609eb2-3a2f-55d8-aabc-08de0cdee792 with scrape type 2
2026-03-30 12:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce609eb2-3a2f-55d8-aabc-08de0cdee792, identifier: AM99663
2026-03-30 12:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce609eb2-3a2f-55d8-aabc-08de0cdee792 with identifier: AM99663
2026-03-30 12:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce609eb2-3a2f-55d8-aabc-08de0cdee792 with identifier: AM99663
2026-03-30 12:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce609eb2-3a2f-55d8-aabc-08de0cdee792 with identifier: AM99663 to the API
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:05:06Z',
'fuel_type': 'petrol',
'id': 'ce609eb2-3a2f-55d8-aabc-08de0cdee792',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM99663',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 119137,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-28',
'seller_name': None,
'title': 'Renault Clio 1.2 Campus Clim',
'transmission': 'manual',
'trim': 'Campus Clim',
'year': 2005}
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM99663%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Saving data for AM99663: {'auction_closing_time': 1774969506.0, 'created_time': 1774512928.998037, 'last_price_update_time': 1774872333.804522}
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM99663') HTTP/1.1" 204 0
2026-03-30 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: RV60833
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: AK05387
2026-03-30 12:05:33 [auto1.fr] INFO: Found listing with ID: ER68789
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER68789%27 HTTP/1.1" 200 None
2026-03-30 12:05:33 [auto1.fr] INFO: Scrape type for ER68789: 2
2026-03-30 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0daef6-101b-5574-8b66-b78632821e6f with identifier: ER68789
2026-03-30 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0daef6-101b-5574-8b66-b78632821e6f with scrape type 2
2026-03-30 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d0daef6-101b-5574-8b66-b78632821e6f with scrape type 2
2026-03-30 12:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d0daef6-101b-5574-8b66-b78632821e6f, identifier: ER68789
2026-03-30 12:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d0daef6-101b-5574-8b66-b78632821e6f with identifier: ER68789
2026-03-30 12:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d0daef6-101b-5574-8b66-b78632821e6f with identifier: ER68789
2026-03-30 12:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d0daef6-101b-5574-8b66-b78632821e6f with identifier: ER68789 to the API
2026-03-30 12:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-31T15:32:40Z',
'fuel_type': 'petrol',
'id': '1d0daef6-101b-5574-8b66-b78632821e6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER68789',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 170037,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-20',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2016}
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER68789%27 HTTP/1.1" 200 None
2026-03-30 12:05:35 [auto1.fr] INFO: Saving data for ER68789: {'auction_closing_time': 1774971160.0, 'created_time': 1773253365.395809, 'last_price_update_time': 1774872335.093168}
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER68789') HTTP/1.1" 204 0
2026-03-30 12:05:35 [auto1.fr] INFO: Found listing with ID: VE80756
2026-03-30 12:05:35 [auto1.fr] INFO: Found listing with ID: GL02133
2026-03-30 12:05:35 [auto1.fr] INFO: Found listing with ID: VX49143
2026-03-30 12:05:35 [auto1.fr] INFO: Found listing with ID: FK23512
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK23512%27 HTTP/1.1" 200 None
2026-03-30 12:05:35 [auto1.fr] INFO: Scrape type for FK23512: 1
2026-03-30 12:05:35 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC31487%27 HTTP/1.1" 200 None
2026-03-30 12:05:35 [auto1.fr] INFO: Scrape type for XC31487: 0
2026-03-30 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW87362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:36 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: JN15401
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: CX38977
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: SV36178
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: DS08848
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: TA72470
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: VV44439
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV44439%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for VV44439: 1
2026-03-30 12:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: BH32555
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: GP66779
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: CY28334
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY28334%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for CY28334: 1
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: LU64065
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: TJ82128
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ82128%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for TJ82128: 1
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: WN55034
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: KD15134
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: PU79516
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: CW34956
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: JX23289
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: ZS17982
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: CZ48020
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: CJ41818
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: LM46920
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM46920%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for LM46920: 1
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: UA34003
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: TV16458
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: BZ85729
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ85729%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for BZ85729: 2
2026-03-30 12:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1aae6f6-42e9-554e-8a60-d5b6db068163 with identifier: BZ85729
2026-03-30 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1aae6f6-42e9-554e-8a60-d5b6db068163 with scrape type 2
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1aae6f6-42e9-554e-8a60-d5b6db068163 with scrape type 2
2026-03-30 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c1aae6f6-42e9-554e-8a60-d5b6db068163, identifier: BZ85729
2026-03-30 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c1aae6f6-42e9-554e-8a60-d5b6db068163 with identifier: BZ85729
2026-03-30 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c1aae6f6-42e9-554e-8a60-d5b6db068163 with identifier: BZ85729
2026-03-30 12:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c1aae6f6-42e9-554e-8a60-d5b6db068163 with identifier: BZ85729 to the API
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:39:29Z',
'fuel_type': 'diesel',
'id': 'c1aae6f6-42e9-554e-8a60-d5b6db068163',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ85729',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 227356,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-14',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2013}
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ85729%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Saving data for BZ85729: {'auction_closing_time': 1774971569.0, 'created_time': 1774279005.004959, 'last_price_update_time': 1774872336.681481}
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BZ85729') HTTP/1.1" 204 0
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: PK34456
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK34456%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for PK34456: 1
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: RR47118
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: ZD92785
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: MB27463
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: ZD67967
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: YP72685
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP72685%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for YP72685: 1
2026-03-30 12:05:36 [auto1.fr] INFO: Found listing with ID: MR68962
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR68962%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [auto1.fr] INFO: Scrape type for MR68962: 2
2026-03-30 12:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3436386b-54be-526e-958f-cb0c818476a9 with identifier: MR68962
2026-03-30 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3436386b-54be-526e-958f-cb0c818476a9 with scrape type 2
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3436386b-54be-526e-958f-cb0c818476a9 with scrape type 2
2026-03-30 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3436386b-54be-526e-958f-cb0c818476a9, identifier: MR68962
2026-03-30 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3436386b-54be-526e-958f-cb0c818476a9 with identifier: MR68962
2026-03-30 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3436386b-54be-526e-958f-cb0c818476a9 with identifier: MR68962
2026-03-30 12:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3436386b-54be-526e-958f-cb0c818476a9 with identifier: MR68962 to the API
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:48:40Z',
'fuel_type': 'diesel',
'id': '3436386b-54be-526e-958f-cb0c818476a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR68962',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 224831,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-20',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2012}
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR68962%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [auto1.fr] INFO: Saving data for MR68962: {'auction_closing_time': 1774972120.0, 'created_time': 1774439821.870642, 'last_price_update_time': 1774872337.292992}
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR68962') HTTP/1.1" 204 0
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: GH19552
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: DS36987
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: AL67797
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: BV40330
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: LW97985
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW97985%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [auto1.fr] INFO: Scrape type for LW97985: 2
2026-03-30 12:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with identifier: LW97985
2026-03-30 12:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with scrape type 2
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with scrape type 2
2026-03-30 12:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 30b2ee32-9196-5393-bcc8-3ec464d5ab63, identifier: LW97985
2026-03-30 12:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with identifier: LW97985
2026-03-30 12:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with identifier: LW97985
2026-03-30 12:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 30b2ee32-9196-5393-bcc8-3ec464d5ab63 with identifier: LW97985 to the API
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:02:34Z',
'fuel_type': 'diesel',
'id': '30b2ee32-9196-5393-bcc8-3ec464d5ab63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW97985',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 218029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-16',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Furio',
'transmission': 'manual',
'trim': 'Furio',
'year': 2010}
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW97985%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [auto1.fr] INFO: Saving data for LW97985: {'auction_closing_time': 1774969354.0, 'created_time': 1774015162.228861, 'last_price_update_time': 1774872337.792138}
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW97985') HTTP/1.1" 204 0
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: CH34160
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: VU62913
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: LH64935
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: MB54534
2026-03-30 12:05:37 [auto1.fr] INFO: Found listing with ID: ZZ76181
2026-03-30 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:39 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: RD23036
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: XZ61201
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: XR77162
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: KZ21626
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: WA74710
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: MZ88866
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: AJ87343
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: HL88307
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL88307%27 HTTP/1.1" 200 None
2026-03-30 12:05:39 [auto1.fr] INFO: Scrape type for HL88307: 2
2026-03-30 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bb8e988-5c41-53cb-82ed-340ac44956ad with identifier: HL88307
2026-03-30 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bb8e988-5c41-53cb-82ed-340ac44956ad with scrape type 2
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bb8e988-5c41-53cb-82ed-340ac44956ad with scrape type 2
2026-03-30 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8bb8e988-5c41-53cb-82ed-340ac44956ad, identifier: HL88307
2026-03-30 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8bb8e988-5c41-53cb-82ed-340ac44956ad with identifier: HL88307
2026-03-30 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8bb8e988-5c41-53cb-82ed-340ac44956ad with identifier: HL88307
2026-03-30 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8bb8e988-5c41-53cb-82ed-340ac44956ad with identifier: HL88307 to the API
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:38:42Z',
'fuel_type': 'petrol',
'id': '8bb8e988-5c41-53cb-82ed-340ac44956ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL88307',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 77290,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-05',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Graphite',
'transmission': 'automatic',
'trim': 'Graphite',
'year': 2017}
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL88307%27 HTTP/1.1" 200 None
2026-03-30 12:05:39 [auto1.fr] INFO: Saving data for HL88307: {'auction_closing_time': 1774971522.0, 'created_time': 1773937553.257867, 'last_price_update_time': 1774872339.48682}
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL88307') HTTP/1.1" 204 0
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: VA96032
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: LL20734
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: VN69868
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 12:05:39 [auto1.fr] INFO: Found listing with ID: TR16969
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR16969%27 HTTP/1.1" 200 None
2026-03-30 12:05:39 [auto1.fr] INFO: Scrape type for TR16969: 2
2026-03-30 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61daa5d4-a736-5b60-bc1c-72d8f546c45c with identifier: TR16969
2026-03-30 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61daa5d4-a736-5b60-bc1c-72d8f546c45c with scrape type 2
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61daa5d4-a736-5b60-bc1c-72d8f546c45c with scrape type 2
2026-03-30 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61daa5d4-a736-5b60-bc1c-72d8f546c45c, identifier: TR16969
2026-03-30 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61daa5d4-a736-5b60-bc1c-72d8f546c45c with identifier: TR16969
2026-03-30 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61daa5d4-a736-5b60-bc1c-72d8f546c45c with identifier: TR16969
2026-03-30 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61daa5d4-a736-5b60-bc1c-72d8f546c45c with identifier: TR16969 to the API
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:19:32Z',
'fuel_type': 'diesel',
'id': '61daa5d4-a736-5b60-bc1c-72d8f546c45c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR16969',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 214471,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-30',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Style",
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR16969%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Saving data for TR16969: {'auction_closing_time': 1774970372.0, 'created_time': 1773121235.064494, 'last_price_update_time': 1774872340.050179}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR16969') HTTP/1.1" 204 0
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: US48890
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US48890%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for US48890: 0
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: SV11482
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: AX27193
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ22847%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for FJ22847: 1
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: GZ22446
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ22446%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for GZ22446: 0
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: TW15870
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: XH52609
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: XC78678
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: CR01658
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: KB47626
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: FC26231
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC26231%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for FC26231: 1
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: NB97574
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: EX66754
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: LW54010
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: CS58382
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: AW86317
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW86317%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for AW86317: 2
2026-03-30 12:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df3b42a1-e2c8-5205-8f4a-ccff663c5941 with identifier: AW86317
2026-03-30 12:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df3b42a1-e2c8-5205-8f4a-ccff663c5941 with scrape type 2
2026-03-30 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df3b42a1-e2c8-5205-8f4a-ccff663c5941 with scrape type 2
2026-03-30 12:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df3b42a1-e2c8-5205-8f4a-ccff663c5941, identifier: AW86317
2026-03-30 12:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df3b42a1-e2c8-5205-8f4a-ccff663c5941 with identifier: AW86317
2026-03-30 12:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df3b42a1-e2c8-5205-8f4a-ccff663c5941 with identifier: AW86317
2026-03-30 12:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df3b42a1-e2c8-5205-8f4a-ccff663c5941 with identifier: AW86317 to the API
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-31T15:48:19Z',
'fuel_type': 'petrol',
'id': 'df3b42a1-e2c8-5205-8f4a-ccff663c5941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW86317',
'listing': 'auction',
'make': 'Maserati',
'model': 'Grecale',
'odometer': 66429,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'seller_name': None,
'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid GT AWD',
'transmission': 'automatic',
'trim': 'GT AWD',
'year': 2022}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW86317%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Saving data for AW86317: {'auction_closing_time': 1774972099.0, 'created_time': 1774015133.830067, 'last_price_update_time': 1774872340.561493}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW86317') HTTP/1.1" 204 0
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: AL79561
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL79561%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for AL79561: 0
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: CR50273
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR50273%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for CR50273: 1
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: VG72144
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: WB58919
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: AZ00821
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: GA93481
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: UC26972
2026-03-30 12:05:40 [auto1.fr] INFO: Found listing with ID: NH21299
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH21299%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.fr] INFO: Scrape type for NH21299: 2
2026-03-30 12:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1d5b68-9080-53e9-b787-b69255337ea0 with identifier: NH21299
2026-03-30 12:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1d5b68-9080-53e9-b787-b69255337ea0 with scrape type 2
2026-03-30 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c1d5b68-9080-53e9-b787-b69255337ea0 with scrape type 2
2026-03-30 12:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9c1d5b68-9080-53e9-b787-b69255337ea0, identifier: NH21299
2026-03-30 12:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9c1d5b68-9080-53e9-b787-b69255337ea0 with identifier: NH21299
2026-03-30 12:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9c1d5b68-9080-53e9-b787-b69255337ea0 with identifier: NH21299
2026-03-30 12:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9c1d5b68-9080-53e9-b787-b69255337ea0 with identifier: NH21299 to the API
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:59:37Z',
'fuel_type': 'diesel',
'id': '9c1d5b68-9080-53e9-b787-b69255337ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH21299',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 154659,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-24',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH21299%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [auto1.fr] INFO: Saving data for NH21299: {'auction_closing_time': 1774972777.0, 'created_time': 1774279014.578142, 'last_price_update_time': 1774872341.181163}
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH21299') HTTP/1.1" 204 0
2026-03-30 12:05:41 [auto1.fr] INFO: Found listing with ID: CP39299
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP39299%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [auto1.fr] INFO: Scrape type for CP39299: 2
2026-03-30 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8dc261b-0d14-55a5-a591-22d458656951 with identifier: CP39299
2026-03-30 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8dc261b-0d14-55a5-a591-22d458656951 with scrape type 2
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8dc261b-0d14-55a5-a591-22d458656951 with scrape type 2
2026-03-30 12:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8dc261b-0d14-55a5-a591-22d458656951, identifier: CP39299
2026-03-30 12:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8dc261b-0d14-55a5-a591-22d458656951 with identifier: CP39299
2026-03-30 12:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8dc261b-0d14-55a5-a591-22d458656951 with identifier: CP39299
2026-03-30 12:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8dc261b-0d14-55a5-a591-22d458656951 with identifier: CP39299 to the API
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:39:04Z',
'fuel_type': 'petrol',
'id': 'f8dc261b-0d14-55a5-a591-22d458656951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP39299',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 178461,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-26',
'seller_name': None,
'title': 'Peugeot 107 1.0 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2008}
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP39299%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [auto1.fr] INFO: Saving data for CP39299: {'auction_closing_time': 1774971544.0, 'created_time': 1772817137.289895, 'last_price_update_time': 1774872341.658275}
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP39299') HTTP/1.1" 204 0
2026-03-30 12:05:41 [auto1.fr] INFO: Found listing with ID: WS13608
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS13608%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [auto1.fr] INFO: Scrape type for WS13608: 2
2026-03-30 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with identifier: WS13608
2026-03-30 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with scrape type 2
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with scrape type 2
2026-03-30 12:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb, identifier: WS13608
2026-03-30 12:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with identifier: WS13608
2026-03-30 12:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with identifier: WS13608
2026-03-30 12:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb with identifier: WS13608 to the API
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:35:48Z',
'fuel_type': 'diesel',
'id': 'ce2dcc96-a25f-5dbc-96b8-32be0a67a6bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS13608',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 220064,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-26',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2016}
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS13608%27 HTTP/1.1" 200 None
2026-03-30 12:05:42 [auto1.fr] INFO: Saving data for WS13608: {'auction_closing_time': 1774971348.0, 'created_time': 1773760841.838083, 'last_price_update_time': 1774872342.124271}
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS13608') HTTP/1.1" 204 0
2026-03-30 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW87362> (referer: https://www.auto1.com/v1/car-details-view/NW87362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e084d335-550f-5369-b577-ce044403ef5b with identifier: NW87362
2026-03-30 12:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e084d335-550f-5369-b577-ce044403ef5b with scrape type 1
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg not downloaded yet
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_eed44c5105b94bcc6961b601e2c029ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_eed44c5105b94bcc6961b601e2c029ff.jpg not downloaded yet
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_786f687329b2136dc57299c09a9fdd95.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_786f687329b2136dc57299c09a9fdd95.jpg not downloaded yet
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_630c7a8151293ef2579025998a00e180.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_630c7a8151293ef2579025998a00e180.jpg not downloaded yet
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg not downloaded yet
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg not downloaded yet
2026-03-30 12:05:48 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 13 pages/min), scraped 68 items (at 19 items/min)
2026-03-30 12:05:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY28334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16cf50>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ82128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_630c7a8151293ef2579025998a00e180.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc9229490>
2026-03-30 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg saved to cache
2026-03-30 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ed710>
2026-03-30 12:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_630c7a8151293ef2579025998a00e180.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_630c7a8151293ef2579025998a00e180.jpg saved to cache
2026-03-30 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM46920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_786f687329b2136dc57299c09a9fdd95.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_eed44c5105b94bcc6961b601e2c029ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc9228910>
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_786f687329b2136dc57299c09a9fdd95.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_786f687329b2136dc57299c09a9fdd95.jpg saved to cache
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a8150>
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_eed44c5105b94bcc6961b601e2c029ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_eed44c5105b94bcc6961b601e2c029ff.jpg saved to cache
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a80d0>
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2f%252F7b2f231532da59d859bcb5d713139963%252Fpa%252FNW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg saved to cache
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e084d335-550f-5369-b577-ce044403ef5b
2026-03-30 12:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e084d335-550f-5369-b577-ce044403ef5b, skipping ID generation
2026-03-30 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e084d335-550f-5369-b577-ce044403ef5b with scrape type 1
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e084d335-550f-5369-b577-ce044403ef5b sending to next pipeline
2026-03-30 12:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e084d335-550f-5369-b577-ce044403ef5b, identifier: NW87362
2026-03-30 12:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e084d335-550f-5369-b577-ce044403ef5b with identifier: NW87362
2026-03-30 12:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e084d335-550f-5369-b577-ce044403ef5b with identifier: NW87362
2026-03-30 12:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e084d335-550f-5369-b577-ce044403ef5b with identifier: NW87362 to the API
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:23:26Z',
'fuel_type': 'petrol',
'id': 'e084d335-550f-5369-b577-ce044403ef5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW87362',
'listing': 'auction',
'location': 'FR, Biarritz',
'make': 'Fiat',
'model': '500C',
'odometer': 183152,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_be8b4bf463ff6596c223f8dfedce83dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_eed44c5105b94bcc6961b601e2c029ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_786f687329b2136dc57299c09a9fdd95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_630c7a8151293ef2579025998a00e180.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_37ec3c982f10b017d074ebb99a78dd8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084d335-550f-5369-b577-ce044403ef5b/e084d335-550f-5369-b577-ce044403ef5b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2f/7b2f231532da59d859bcb5d713139963/pa/NW87362_94c9bee40e0dd9f67d185f8c22bc8562.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-10-15',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2009}
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW87362%27 HTTP/1.1" 200 None
2026-03-30 12:06:10 [auto1.fr] INFO: Saving data for NW87362: {'created_time': 1774872370.74706, 'last_price_update_time': 1774872370.747076, 'auction_closing_time': 1774970606.0}
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW87362') HTTP/1.1" 204 0
2026-03-30 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK34456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP72685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV44439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:22 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 5701 | hits on page: 40
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: NH21299
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH21299%27 HTTP/1.1" 200 None
2026-03-30 12:06:22 [auto1.fr] INFO: Scrape type for NH21299: 0
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: CP39299
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP39299%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for CP39299: 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: WS13608
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS13608%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for WS13608: 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: PU29197
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: XT72733
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: LF56944
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF56944%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for LF56944: 1
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: UH12185
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: DZ81197
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: MA18623
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: TC25097
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC25097%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for TC25097: 2
2026-03-30 12:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551586ab-b047-5c37-bdca-fd485a2a4cca with identifier: TC25097
2026-03-30 12:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551586ab-b047-5c37-bdca-fd485a2a4cca with scrape type 2
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 551586ab-b047-5c37-bdca-fd485a2a4cca with scrape type 2
2026-03-30 12:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 551586ab-b047-5c37-bdca-fd485a2a4cca, identifier: TC25097
2026-03-30 12:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 551586ab-b047-5c37-bdca-fd485a2a4cca with identifier: TC25097
2026-03-30 12:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 551586ab-b047-5c37-bdca-fd485a2a4cca with identifier: TC25097
2026-03-30 12:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 551586ab-b047-5c37-bdca-fd485a2a4cca with identifier: TC25097 to the API
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:02:30Z',
'fuel_type': 'diesel',
'id': '551586ab-b047-5c37-bdca-fd485a2a4cca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC25097',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 264628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-03',
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC25097%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Saving data for TC25097: {'auction_closing_time': 1774969350.0, 'created_time': 1773692792.670545, 'last_price_update_time': 1774872383.588843}
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC25097') HTTP/1.1" 204 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: WV40426
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: KP00368
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: KJ96172
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ96172%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for KJ96172: 1
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: VP01929
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP01929%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for VP01929: 1
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: DN93409
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: ZT48297
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT48297%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for ZT48297: 2
2026-03-30 12:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf6c633-f44a-52ca-b303-d7bc4b75351a with identifier: ZT48297
2026-03-30 12:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf6c633-f44a-52ca-b303-d7bc4b75351a with scrape type 2
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf6c633-f44a-52ca-b303-d7bc4b75351a with scrape type 2
2026-03-30 12:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eaf6c633-f44a-52ca-b303-d7bc4b75351a, identifier: ZT48297
2026-03-30 12:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eaf6c633-f44a-52ca-b303-d7bc4b75351a with identifier: ZT48297
2026-03-30 12:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eaf6c633-f44a-52ca-b303-d7bc4b75351a with identifier: ZT48297
2026-03-30 12:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eaf6c633-f44a-52ca-b303-d7bc4b75351a with identifier: ZT48297 to the API
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 109,
'expiration_date': '2026-03-31T15:43:06Z',
'fuel_type': 'diesel',
'id': 'eaf6c633-f44a-52ca-b303-d7bc4b75351a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT48297',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 297522,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-25',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Pack Ambiance',
'transmission': 'automatic',
'trim': 'Pack Ambiance',
'year': 2008}
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT48297%27 HTTP/1.1" 200 None
2026-03-30 12:06:24 [auto1.fr] INFO: Saving data for ZT48297: {'auction_closing_time': 1774971786.0, 'created_time': 1774643938.322395, 'last_price_update_time': 1774872384.23265}
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZT48297') HTTP/1.1" 204 0
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: JV70859
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: XH92136
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: NT04558
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: BB11849
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB11849%27 HTTP/1.1" 200 None
2026-03-30 12:06:24 [auto1.fr] INFO: Scrape type for BB11849: 1
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: XK65376
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: LY92555
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: YU12489
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: ZN46810
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: LW10952
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: LT66464
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: LW75647
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: YJ52141
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ52141%27 HTTP/1.1" 200 None
2026-03-30 12:06:24 [auto1.fr] INFO: Scrape type for YJ52141: 1
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ22847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: KR46154
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: YK40789
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: EY54413
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: LZ23013
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: RA80092
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: FJ82721
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: KU85731
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: YG09777
2026-03-30 12:06:24 [auto1.fr] INFO: Found listing with ID: XC64901
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC64901%27 HTTP/1.1" 200 None
2026-03-30 12:06:24 [auto1.fr] INFO: Scrape type for XC64901: 2
2026-03-30 12:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbcdf14c-2f61-5104-a766-e038b26ff1e6 with identifier: XC64901
2026-03-30 12:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcdf14c-2f61-5104-a766-e038b26ff1e6 with scrape type 2
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbcdf14c-2f61-5104-a766-e038b26ff1e6 with scrape type 2
2026-03-30 12:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dbcdf14c-2f61-5104-a766-e038b26ff1e6, identifier: XC64901
2026-03-30 12:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dbcdf14c-2f61-5104-a766-e038b26ff1e6 with identifier: XC64901
2026-03-30 12:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dbcdf14c-2f61-5104-a766-e038b26ff1e6 with identifier: XC64901
2026-03-30 12:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dbcdf14c-2f61-5104-a766-e038b26ff1e6 with identifier: XC64901 to the API
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 113,
'expiration_date': '2026-03-31T15:44:13Z',
'fuel_type': 'petrol',
'id': 'dbcdf14c-2f61-5104-a766-e038b26ff1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC64901',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 164580,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-27',
'seller_name': None,
'title': 'Renault Megane 1.6 Dynamique Luxe',
'transmission': 'manual',
'trim': 'Dynamique Luxe',
'year': 2006}
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC64901%27 HTTP/1.1" 200 None
2026-03-30 12:06:24 [auto1.fr] INFO: Saving data for XC64901: {'auction_closing_time': 1774971853.0, 'created_time': 1774279006.633676, 'last_price_update_time': 1774872384.918823}
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC64901') HTTP/1.1" 204 0
2026-03-30 12:06:25 [auto1.fr] INFO: Found listing with ID: GD84445
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84445%27 HTTP/1.1" 200 None
2026-03-30 12:06:25 [auto1.fr] INFO: Scrape type for GD84445: 1
2026-03-30 12:06:25 [auto1.fr] INFO: Found listing with ID: CN95140
2026-03-30 12:06:25 [auto1.fr] INFO: Found listing with ID: LJ04008
2026-03-30 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC26231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR50273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.283(s), this was the 1st time calling it.
2026-03-30 12:06:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.978169070298918 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ82128> (referer: https://www.auto1.com/v1/car-details-view/TJ82128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with identifier: TJ82128
2026-03-30 12:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with scrape type 1
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_d47440b76157953945a0bb13e243b46c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d47440b76157953945a0bb13e243b46c.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_90975a618ccddc381f18757279d376bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_90975a618ccddc381f18757279d376bc.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_86777277ee3d809face325430808c783.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_86777277ee3d809face325430808c783.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg not downloaded yet
2026-03-30 12:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY28334> (referer: https://www.auto1.com/v1/car-details-view/CY28334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_ccae7218f7a1536546fecb9c440496e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ccae7218f7a1536546fecb9c440496e8.jpg not downloaded yet
2026-03-30 12:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_3dd203d2464d1bc69c624909a08ec603.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_3dd203d2464d1bc69c624909a08ec603.jpg not downloaded yet
2026-03-30 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg not downloaded yet
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg not downloaded yet
2026-03-30 12:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c84d913-bb13-519f-b247-b4aa5b47161f with identifier: CY28334
2026-03-30 12:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c84d913-bb13-519f-b247-b4aa5b47161f with scrape type 1
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c84d913-bb13-519f-b247-b4aa5b47161f
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_994d4768b1721434d02a8e62eda9028a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_994d4768b1721434d02a8e62eda9028a.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_bc53054bef265593f62fc4cfbb745413.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_bc53054bef265593f62fc4cfbb745413.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_337b0b388b176067647e695dc53eca03.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_337b0b388b176067647e695dc53eca03.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_7c7a22972569e2a75142853863a29413.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_7c7a22972569e2a75142853863a29413.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_8361b3e2e6ae8a461618645cecbf89e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_8361b3e2e6ae8a461618645cecbf89e2.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_33f8b1f723cfc12362ec5c73da2a11ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_33f8b1f723cfc12362ec5c73da2a11ce.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_d8e5a6ebfb1fc33a0d82b10ab2683466.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_d8e5a6ebfb1fc33a0d82b10ab2683466.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_68ef1f63b5d602d2543375daa78e6963.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_68ef1f63b5d602d2543375daa78e6963.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_aea7ecf72967ca8beabe66da486c2d95.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_aea7ecf72967ca8beabe66da486c2d95.jpg already downloaded
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F94%252Fe29404c3e8f7816d31ae676cc3c268dc%252Fpa%252FCY28334_2ffc745525fac2c44be393b3266c04cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_2ffc745525fac2c44be393b3266c04cb.jpg already downloaded
2026-03-30 12:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c84d913-bb13-519f-b247-b4aa5b47161f, identifier: CY28334
2026-03-30 12:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c84d913-bb13-519f-b247-b4aa5b47161f with identifier: CY28334
2026-03-30 12:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c84d913-bb13-519f-b247-b4aa5b47161f with identifier: CY28334
2026-03-30 12:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6c84d913-bb13-519f-b247-b4aa5b47161f with identifier: CY28334 to the API
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY28334>
{'auction_title': '',
'c_o_2_emission_value': 84,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:48:29Z',
'fuel_type': 'hybrid',
'id': '6c84d913-bb13-519f-b247-b4aa5b47161f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY28334',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 80987,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_994d4768b1721434d02a8e62eda9028a.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_bc53054bef265593f62fc4cfbb745413.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_337b0b388b176067647e695dc53eca03.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_7c7a22972569e2a75142853863a29413.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_8361b3e2e6ae8a461618645cecbf89e2.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_33f8b1f723cfc12362ec5c73da2a11ce.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_d8e5a6ebfb1fc33a0d82b10ab2683466.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_68ef1f63b5d602d2543375daa78e6963.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_aea7ecf72967ca8beabe66da486c2d95.jpg',
'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_2ffc745525fac2c44be393b3266c04cb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_994d4768b1721434d02a8e62eda9028a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_bc53054bef265593f62fc4cfbb745413.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_337b0b388b176067647e695dc53eca03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_7c7a22972569e2a75142853863a29413.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_8361b3e2e6ae8a461618645cecbf89e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_33f8b1f723cfc12362ec5c73da2a11ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_d8e5a6ebfb1fc33a0d82b10ab2683466.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_68ef1f63b5d602d2543375daa78e6963.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_aea7ecf72967ca8beabe66da486c2d95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c84d913-bb13-519f-b247-b4aa5b47161f/6c84d913-bb13-519f-b247-b4aa5b47161f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/94/e29404c3e8f7816d31ae676cc3c268dc/pa/CY28334_2ffc745525fac2c44be393b3266c04cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Dynamic Business',
'transmission': 'automatic',
'trim': 'Dynamic Business',
'year': 2018}
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY28334%27 HTTP/1.1" 200 None
2026-03-30 12:06:34 [auto1.fr] INFO: Saving data for CY28334: {'created_time': 1774872394.702478, 'last_price_update_time': 1774872394.702493, 'auction_closing_time': 1774972109.0}
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY28334') HTTP/1.1" 204 0
2026-03-30 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2efe50>
2026-03-30 12:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg saved to cache
2026-03-30 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca106b10>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922cf90>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_3dd203d2464d1bc69c624909a08ec603.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac74650>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_3dd203d2464d1bc69c624909a08ec603.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_3dd203d2464d1bc69c624909a08ec603.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ccae7218f7a1536546fecb9c440496e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_86777277ee3d809face325430808c783.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a5ad0>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_ccae7218f7a1536546fecb9c440496e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ccae7218f7a1536546fecb9c440496e8.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_90975a618ccddc381f18757279d376bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ed710>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_86777277ee3d809face325430808c783.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_86777277ee3d809face325430808c783.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca104dd0>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f2ed0>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_90975a618ccddc381f18757279d376bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_90975a618ccddc381f18757279d376bc.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d47440b76157953945a0bb13e243b46c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2cc810>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_d47440b76157953945a0bb13e243b46c.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d47440b76157953945a0bb13e243b46c.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca183c10>
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F07%252F5a0779aa9a3ef7784015a5e17327e057%252Fpa%252FTJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg saved to cache
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7
2026-03-30 12:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7, skipping ID generation
2026-03-30 12:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with scrape type 1
2026-03-30 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 sending to next pipeline
2026-03-30 12:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7, identifier: TJ82128
2026-03-30 12:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with identifier: TJ82128
2026-03-30 12:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with identifier: TJ82128
2026-03-30 12:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7 with identifier: TJ82128 to the API
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:03:57Z',
'fuel_type': 'petrol',
'id': '21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ82128',
'listing': 'auction',
'location': 'FR, Orgeval',
'make': 'MINI',
'model': 'MINI',
'odometer': 31426,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d17acbfb7989e815a985a66e45fec0c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_d47440b76157953945a0bb13e243b46c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_90975a618ccddc381f18757279d376bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_678591b25ea22c42c49bc3c8b4b1486e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_86777277ee3d809face325430808c783.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ae563905e73780fd7f6b3c37c985af3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_ccae7218f7a1536546fecb9c440496e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_3dd203d2464d1bc69c624909a08ec603.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_b3ba5b745fefa7f04d04485f1f9be87a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7/21c4d5b6-65fd-5cd5-b69d-54ce1abf84f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/07/5a0779aa9a3ef7784015a5e17327e057/pa/TJ82128_2d0a6cbd6ec3b00992db12a2a7a66d36.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-02',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One First',
'transmission': 'manual',
'trim': 'First',
'year': 2019}
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ82128%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [auto1.fr] INFO: Saving data for TJ82128: {'created_time': 1774872396.537716, 'last_price_update_time': 1774872396.537727, 'auction_closing_time': 1774969437.0}
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ82128') HTTP/1.1" 204 0
2026-03-30 12:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM46920> (referer: https://www.auto1.com/v1/car-details-view/LM46920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028bb6d7-74c7-5d43-81af-22f87a4fa58b with identifier: LM46920
2026-03-30 12:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b with scrape type 1
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_03ef2c526f5ac568011b84edb3cf9775.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_03ef2c526f5ac568011b84edb3cf9775.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_30223a492b6aa082f4781809bae5650d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_30223a492b6aa082f4781809bae5650d.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_ba873fc2003d550df6938c2e28c87b80.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ba873fc2003d550df6938c2e28c87b80.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_ca0cee731628c066a57fefcbb58e48b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ca0cee731628c066a57fefcbb58e48b2.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_f19d195c2c1c6ca80875b456e9739832.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_f19d195c2c1c6ca80875b456e9739832.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_769314f3222ea5b88c47deeabfd6d402.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_769314f3222ea5b88c47deeabfd6d402.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_0098397df7702c8af5a2c50e1113c244.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_0098397df7702c8af5a2c50e1113c244.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_bd1472616084d76cc578a5145208f7ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_bd1472616084d76cc578a5145208f7ab.jpg not downloaded yet
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg not downloaded yet
2026-03-30 12:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD54600> (referer: https://www.auto1.com/v1/car-details-view/SD54600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with identifier: SD54600
2026-03-30 12:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with scrape type 1
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg not downloaded yet
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_bd1472616084d76cc578a5145208f7ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_2804f884cb1b7fad671d5382d6026b74.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_2804f884cb1b7fad671d5382d6026b74.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_e37e836702275ef64301e01bd51222dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_e37e836702275ef64301e01bd51222dc.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg not downloaded yet
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1eced0>
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg saved to cache
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg not downloaded yet
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2966d0>
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_bd1472616084d76cc578a5145208f7ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_bd1472616084d76cc578a5145208f7ab.jpg saved to cache
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_81fac686315077c7897624f90aa40606.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_81fac686315077c7897624f90aa40606.jpg not downloaded yet
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg not downloaded yet
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2de510>
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg saved to cache
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca297910>
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg saved to cache
2026-03-30 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_81fac686315077c7897624f90aa40606.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca144e50>
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ea290>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_81fac686315077c7897624f90aa40606.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_81fac686315077c7897624f90aa40606.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc6590>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca154e10>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ad690>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_e37e836702275ef64301e01bd51222dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e10d0>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_e37e836702275ef64301e01bd51222dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_e37e836702275ef64301e01bd51222dc.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e26d0>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg saved to cache
2026-03-30 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_2804f884cb1b7fad671d5382d6026b74.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_0098397df7702c8af5a2c50e1113c244.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca157b90>
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8a%252Ffc8a5b94bf7e8e0c9be730e0c5259fb7%252Fpa%252FSD54600_2804f884cb1b7fad671d5382d6026b74.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_2804f884cb1b7fad671d5382d6026b74.jpg saved to cache
2026-03-30 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95
2026-03-30 12:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05ffbb6a-95b3-5633-a777-f956fd8d2f95, skipping ID generation
2026-03-30 12:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with scrape type 1
2026-03-30 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05ffbb6a-95b3-5633-a777-f956fd8d2f95 sending to next pipeline
2026-03-30 12:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05ffbb6a-95b3-5633-a777-f956fd8d2f95, identifier: SD54600
2026-03-30 12:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with identifier: SD54600
2026-03-30 12:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with identifier: SD54600
2026-03-30 12:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 05ffbb6a-95b3-5633-a777-f956fd8d2f95 with identifier: SD54600 to the API
2026-03-30 12:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_2804f884cb1b7fad671d5382d6026b74.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:19:17Z',
'fuel_type': 'hybrid',
'id': '05ffbb6a-95b3-5633-a777-f956fd8d2f95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD54600',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Ford',
'model': 'Kuga',
'odometer': 58402,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40222,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a87904f13f8b26d9562d34b34a2d73ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40222,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_2804f884cb1b7fad671d5382d6026b74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39676,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_6dea00c0c42f8c827644f7ac7ed72b58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36457,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_e37e836702275ef64301e01bd51222dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31141,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_a123509fdcfc4c93e9cb444717d91ba5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40345,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_fbd81c1ee1cae07d0e66d4abb0574e2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36666,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_cbf9fdbecb0f50aa3a3e3586d376a95f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39911,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_9e0df79fe15a55f7d5d7fb5eecd919e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31382,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_81fac686315077c7897624f90aa40606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ffbb6a-95b3-5633-a777-f956fd8d2f95/05ffbb6a-95b3-5633-a777-f956fd8d2f95_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34842,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/8a/fc8a5b94bf7e8e0c9be730e0c5259fb7/pa/SD54600_14d3c714572e2e704ecb4563ef9ff3a7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2020}
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD54600%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [auto1.fr] INFO: Saving data for SD54600: {'created_time': 1774872402.41775, 'last_price_update_time': 1774872402.417761, 'auction_closing_time': 1774970357.0}
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SD54600') HTTP/1.1" 204 0
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_769314f3222ea5b88c47deeabfd6d402.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV44439> (referer: https://www.auto1.com/v1/car-details-view/VV44439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK34456> (referer: https://www.auto1.com/v1/car-details-view/PK34456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca241450>
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_0098397df7702c8af5a2c50e1113c244.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_0098397df7702c8af5a2c50e1113c244.jpg saved to cache
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_f19d195c2c1c6ca80875b456e9739832.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ba873fc2003d550df6938c2e28c87b80.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b2f10>
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_769314f3222ea5b88c47deeabfd6d402.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_769314f3222ea5b88c47deeabfd6d402.jpg saved to cache
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_30223a492b6aa082f4781809bae5650d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070faf26-671f-5b14-b3b0-de90477b904e with identifier: VV44439
2026-03-30 12:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070faf26-671f-5b14-b3b0-de90477b904e with scrape type 1
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_209828e7b521f985e93f68d0ac693c48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_209828e7b521f985e93f68d0ac693c48.jpg not downloaded yet
2026-03-30 12:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869ec999-6ecd-5853-be47-923ae163ae7b with identifier: PK34456
2026-03-30 12:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869ec999-6ecd-5853-be47-923ae163ae7b with scrape type 1
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 869ec999-6ecd-5853-be47-923ae163ae7b
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_1fbdf14a8951361763f27371ea0a8719.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_1fbdf14a8951361763f27371ea0a8719.jpg already downloaded
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_cd0713fe47613325f2b78d8683dbb6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_cd0713fe47613325f2b78d8683dbb6d1.jpg already downloaded
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_af8a4225002492c25928d77a7b6b67aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_af8a4225002492c25928d77a7b6b67aa.jpg already downloaded
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_928ee6a9dc07c2c498d12d20b8e4119c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_928ee6a9dc07c2c498d12d20b8e4119c.jpg already downloaded
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_ae34a4c900b13c91dc2ac65f6c526690.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_ae34a4c900b13c91dc2ac65f6c526690.jpg already downloaded
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc6%252F01c6ba3cf312dd5f44e8215a979a3114%252Fpa%252FPK34456_d87bfaee94fbc3ba8b38fc22e8d013d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_d87bfaee94fbc3ba8b38fc22e8d013d2.jpg already downloaded
2026-03-30 12:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 869ec999-6ecd-5853-be47-923ae163ae7b, identifier: PK34456
2026-03-30 12:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 869ec999-6ecd-5853-be47-923ae163ae7b with identifier: PK34456
2026-03-30 12:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 869ec999-6ecd-5853-be47-923ae163ae7b with identifier: PK34456
2026-03-30 12:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 869ec999-6ecd-5853-be47-923ae163ae7b with identifier: PK34456 to the API
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK34456>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.6L',
'engine_horse_power': 107,
'expiration_date': '2026-03-31T15:29:37Z',
'fuel_type': 'petrol',
'id': '869ec999-6ecd-5853-be47-923ae163ae7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK34456',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Renault',
'model': 'Clio',
'odometer': 126785,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_1fbdf14a8951361763f27371ea0a8719.jpg',
'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_cd0713fe47613325f2b78d8683dbb6d1.jpg',
'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_af8a4225002492c25928d77a7b6b67aa.jpg',
'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_928ee6a9dc07c2c498d12d20b8e4119c.jpg',
'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_ae34a4c900b13c91dc2ac65f6c526690.jpg',
'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_d87bfaee94fbc3ba8b38fc22e8d013d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_1fbdf14a8951361763f27371ea0a8719.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_cd0713fe47613325f2b78d8683dbb6d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_af8a4225002492c25928d77a7b6b67aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_928ee6a9dc07c2c498d12d20b8e4119c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_ae34a4c900b13c91dc2ac65f6c526690.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869ec999-6ecd-5853-be47-923ae163ae7b/869ec999-6ecd-5853-be47-923ae163ae7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/c6/01c6ba3cf312dd5f44e8215a979a3114/pa/PK34456_d87bfaee94fbc3ba8b38fc22e8d013d2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.6 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK34456%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [auto1.fr] INFO: Saving data for PK34456: {'created_time': 1774872403.204829, 'last_price_update_time': 1774872403.204842, 'auction_closing_time': 1774970977.0}
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK34456') HTTP/1.1" 204 0
2026-03-30 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_03ef2c526f5ac568011b84edb3cf9775.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_23453aba9e0d266c9df64093c0746e26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_23453aba9e0d266c9df64093c0746e26.jpg not downloaded yet
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8869ac532ef633d928c0c4596396bd0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8869ac532ef633d928c0c4596396bd0d.jpg not downloaded yet
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f4110>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_f19d195c2c1c6ca80875b456e9739832.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_f19d195c2c1c6ca80875b456e9739832.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f1910>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_ba873fc2003d550df6938c2e28c87b80.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ba873fc2003d550df6938c2e28c87b80.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a4310>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_30223a492b6aa082f4781809bae5650d.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_30223a492b6aa082f4781809bae5650d.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ca0cee731628c066a57fefcbb58e48b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg not downloaded yet
2026-03-30 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg not downloaded yet
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab19c10>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_03ef2c526f5ac568011b84edb3cf9775.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_03ef2c526f5ac568011b84edb3cf9775.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg not downloaded yet
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8f07e75e3ff868299b56b6bb981813c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8f07e75e3ff868299b56b6bb981813c4.jpg not downloaded yet
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b3e90>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_ca0cee731628c066a57fefcbb58e48b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ca0cee731628c066a57fefcbb58e48b2.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ef190>
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fdd%252F1bdd62311fe17389e157fa0975b199a7%252Fpa%252FLM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg saved to cache
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b
2026-03-30 12:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 028bb6d7-74c7-5d43-81af-22f87a4fa58b, skipping ID generation
2026-03-30 12:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b with scrape type 1
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 028bb6d7-74c7-5d43-81af-22f87a4fa58b sending to next pipeline
2026-03-30 12:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 028bb6d7-74c7-5d43-81af-22f87a4fa58b, identifier: LM46920
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_84a90419f0566c590ec679dd377ca188.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_84a90419f0566c590ec679dd377ca188.jpg not downloaded yet
2026-03-30 12:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 028bb6d7-74c7-5d43-81af-22f87a4fa58b with identifier: LM46920
2026-03-30 12:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 028bb6d7-74c7-5d43-81af-22f87a4fa58b with identifier: LM46920
2026-03-30 12:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 028bb6d7-74c7-5d43-81af-22f87a4fa58b with identifier: LM46920 to the API
2026-03-30 12:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:04:40Z',
'fuel_type': 'diesel',
'id': '028bb6d7-74c7-5d43-81af-22f87a4fa58b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM46920',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 189063,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_03ef2c526f5ac568011b84edb3cf9775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_30223a492b6aa082f4781809bae5650d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ba873fc2003d550df6938c2e28c87b80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_202b2b871d00e86f306d7ac1ae6feae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_ca0cee731628c066a57fefcbb58e48b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_f19d195c2c1c6ca80875b456e9739832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_769314f3222ea5b88c47deeabfd6d402.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_0098397df7702c8af5a2c50e1113c244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_bd1472616084d76cc578a5145208f7ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028bb6d7-74c7-5d43-81af-22f87a4fa58b/028bb6d7-74c7-5d43-81af-22f87a4fa58b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/dd/1bdd62311fe17389e157fa0975b199a7/pa/LM46920_a34ff9ba694dc9f689da451daa0d96b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Intensive',
'transmission': 'manual',
'trim': 'Intensive',
'year': 2015}
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM46920%27 HTTP/1.1" 200 None
2026-03-30 12:06:44 [auto1.fr] INFO: Saving data for LM46920: {'created_time': 1774872404.168953, 'last_price_update_time': 1774872404.168965, 'auction_closing_time': 1774969480.0}
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM46920') HTTP/1.1" 204 0
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_23453aba9e0d266c9df64093c0746e26.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg not downloaded yet
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_158cbc9f652bb181874602b53797a488.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_158cbc9f652bb181874602b53797a488.jpg not downloaded yet
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8869ac532ef633d928c0c4596396bd0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8f07e75e3ff868299b56b6bb981813c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16ed90>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_23453aba9e0d266c9df64093c0746e26.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_23453aba9e0d266c9df64093c0746e26.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_158cbc9f652bb181874602b53797a488.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca105390>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8869ac532ef633d928c0c4596396bd0d.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8869ac532ef633d928c0c4596396bd0d.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_84a90419f0566c590ec679dd377ca188.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc5a50>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8f07e75e3ff868299b56b6bb981813c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8f07e75e3ff868299b56b6bb981813c4.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14b2d0>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12cf50>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_158cbc9f652bb181874602b53797a488.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_158cbc9f652bb181874602b53797a488.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_209828e7b521f985e93f68d0ac693c48.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b5cd0>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_84a90419f0566c590ec679dd377ca188.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_84a90419f0566c590ec679dd377ca188.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c6810>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_209828e7b521f985e93f68d0ac693c48.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_209828e7b521f985e93f68d0ac693c48.jpg saved to cache
2026-03-30 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14b890>
2026-03-30 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg saved to cache
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0fab9d0>
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg saved to cache
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e4650>
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F02%252F2f025a85f38e6f7abd567299e3a439f0%252Fpa%252FVV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg saved to cache
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 070faf26-671f-5b14-b3b0-de90477b904e
2026-03-30 12:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 070faf26-671f-5b14-b3b0-de90477b904e, skipping ID generation
2026-03-30 12:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070faf26-671f-5b14-b3b0-de90477b904e with scrape type 1
2026-03-30 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 070faf26-671f-5b14-b3b0-de90477b904e sending to next pipeline
2026-03-30 12:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 070faf26-671f-5b14-b3b0-de90477b904e, identifier: VV44439
2026-03-30 12:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 070faf26-671f-5b14-b3b0-de90477b904e with identifier: VV44439
2026-03-30 12:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 070faf26-671f-5b14-b3b0-de90477b904e with identifier: VV44439
2026-03-30 12:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 070faf26-671f-5b14-b3b0-de90477b904e with identifier: VV44439 to the API
2026-03-30 12:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:55:31Z',
'fuel_type': 'petrol',
'id': '070faf26-671f-5b14-b3b0-de90477b904e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV44439',
'listing': 'auction',
'location': 'FR, Croissy-Beaubourg',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 136688,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2879748,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_209828e7b521f985e93f68d0ac693c48.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_23453aba9e0d266c9df64093c0746e26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2984032,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8869ac532ef633d928c0c4596396bd0d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3076240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_6ad6fec5a57ef1fe9816424ef7d9aded.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8b4a4bf0dde1e38bcd189ee4e3fe0090.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3083053,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_b0d5ea0f01be82248cd56b00cb2b104a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_8f07e75e3ff868299b56b6bb981813c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_84a90419f0566c590ec679dd377ca188.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_c13dc4655bb9c2a1182bdac8caef4706.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070faf26-671f-5b14-b3b0-de90477b904e/070faf26-671f-5b14-b3b0-de90477b904e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3067587,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/02/2f025a85f38e6f7abd567299e3a439f0/pa/VV44439_158cbc9f652bb181874602b53797a488.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2016}
2026-03-30 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV44439%27 HTTP/1.1" 200 None
2026-03-30 12:06:46 [auto1.fr] INFO: Saving data for VV44439: {'created_time': 1774872406.177446, 'last_price_update_time': 1774872406.177458, 'auction_closing_time': 1774972531.0}
2026-03-30 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV44439') HTTP/1.1" 204 0
2026-03-30 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:47 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 5701 | hits on page: 40
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: TF16696
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: KK63519
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: RL53733
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL53733%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Scrape type for RL53733: 2
2026-03-30 12:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd6b570-120e-5736-8b31-029dfb9375f4 with identifier: RL53733
2026-03-30 12:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd6b570-120e-5736-8b31-029dfb9375f4 with scrape type 2
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fd6b570-120e-5736-8b31-029dfb9375f4 with scrape type 2
2026-03-30 12:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fd6b570-120e-5736-8b31-029dfb9375f4, identifier: RL53733
2026-03-30 12:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fd6b570-120e-5736-8b31-029dfb9375f4 with identifier: RL53733
2026-03-30 12:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fd6b570-120e-5736-8b31-029dfb9375f4 with identifier: RL53733
2026-03-30 12:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6fd6b570-120e-5736-8b31-029dfb9375f4 with identifier: RL53733 to the API
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:06:20Z',
'fuel_type': 'petrol',
'id': '6fd6b570-120e-5736-8b31-029dfb9375f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL53733',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 99038,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-27',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL53733%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Saving data for RL53733: {'auction_closing_time': 1774969580.0, 'created_time': 1773293526.04578, 'last_price_update_time': 1774872407.568945}
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RL53733') HTTP/1.1" 204 0
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: UG05877
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: YS05560
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: KP55875
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: EB66083
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: XG43753
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG43753%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Scrape type for XG43753: 1
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: KE63825
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: FV31615
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: GU57901
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: ZS16688
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: FY42182
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY42182%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Scrape type for FY42182: 0
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: GN38354
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: GV41171
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: BL33771
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL33771%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Scrape type for BL33771: 1
2026-03-30 12:06:47 [auto1.fr] INFO: Found listing with ID: RZ77484
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ77484%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [auto1.fr] INFO: Scrape type for RZ77484: 2
2026-03-30 12:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-03-30 12:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with scrape type 2
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with scrape type 2
2026-03-30 12:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8, identifier: RZ77484
2026-03-30 12:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-03-30 12:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-03-30 12:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484 to the API
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:24:44Z',
'fuel_type': 'petrol',
'id': '3c0aed2e-9e70-5a33-b26b-2066e386c1f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ77484',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 114146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-31',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2012}
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ77484%27 HTTP/1.1" 200 None
2026-03-30 12:06:48 [auto1.fr] INFO: Saving data for RZ77484: {'auction_closing_time': 1774970684.0, 'created_time': 1773676287.739556, 'last_price_update_time': 1774872408.405771}
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ77484') HTTP/1.1" 204 0
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: RG39799
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: AR51988
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: GD65166
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: VA51344
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: MP21660
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: PF69474
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF69474%27 HTTP/1.1" 200 None
2026-03-30 12:06:48 [auto1.fr] INFO: Scrape type for PF69474: 1
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: DW49496
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: FB81487
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: NY56342
2026-03-30 12:06:48 [auto1.fr] INFO: Found listing with ID: LL57961
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL57961%27 HTTP/1.1" 200 None
2026-03-30 12:06:48 [auto1.fr] INFO: Scrape type for LL57961: 2
2026-03-30 12:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7b0641-d43b-58df-854e-41c21e42266d with identifier: LL57961
2026-03-30 12:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7b0641-d43b-58df-854e-41c21e42266d with scrape type 2
2026-03-30 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7b0641-d43b-58df-854e-41c21e42266d with scrape type 2
2026-03-30 12:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c7b0641-d43b-58df-854e-41c21e42266d, identifier: LL57961
2026-03-30 12:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c7b0641-d43b-58df-854e-41c21e42266d with identifier: LL57961
2026-03-30 12:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c7b0641-d43b-58df-854e-41c21e42266d with identifier: LL57961
2026-03-30 12:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c7b0641-d43b-58df-854e-41c21e42266d with identifier: LL57961 to the API
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:06:30Z',
'fuel_type': 'diesel',
'id': '0c7b0641-d43b-58df-854e-41c21e42266d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL57961',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 103402,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-31',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350 d 4Matic BlueTEC',
'transmission': 'automatic',
'trim': '4Matic BlueTEC',
'year': 2014}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL57961%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Saving data for LL57961: {'auction_closing_time': 1774969590.0, 'created_time': 1774385190.150494, 'last_price_update_time': 1774872409.038421}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL57961') HTTP/1.1" 204 0
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: PS75557
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: UE94565
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: HA13685
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: JZ33313
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: CH28631
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH28631%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Scrape type for CH28631: 2
2026-03-30 12:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with identifier: CH28631
2026-03-30 12:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with scrape type 2
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with scrape type 2
2026-03-30 12:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ed0fb4c-3241-5854-98f2-22fd7cc82641, identifier: CH28631
2026-03-30 12:06:49 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 17 pages/min), scraped 81 items (at 13 items/min)
2026-03-30 12:06:49 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with identifier: CH28631
2026-03-30 12:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with identifier: CH28631
2026-03-30 12:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ed0fb4c-3241-5854-98f2-22fd7cc82641 with identifier: CH28631 to the API
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:16:08Z',
'fuel_type': 'diesel',
'id': '7ed0fb4c-3241-5854-98f2-22fd7cc82641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH28631',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 207435,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-04',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Live',
'transmission': 'manual',
'trim': 'Live',
'year': 2015}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH28631%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Saving data for CH28631: {'auction_closing_time': 1774970168.0, 'created_time': 1772872298.894433, 'last_price_update_time': 1774872409.492226}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH28631') HTTP/1.1" 204 0
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: RN18234
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: YT40335
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: LG92938
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: WA37151
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: TC10044
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: JR90965
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR90965%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Scrape type for JR90965: 1
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: PS40774
2026-03-30 12:06:49 [auto1.fr] INFO: Found listing with ID: KG78882
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG78882%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Scrape type for KG78882: 1
2026-03-30 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP72685> (referer: https://www.auto1.com/v1/car-details-view/YP72685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99750173-9566-5a53-a7ae-c7af054be902 with identifier: YP72685
2026-03-30 12:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99750173-9566-5a53-a7ae-c7af054be902 with scrape type 1
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99750173-9566-5a53-a7ae-c7af054be902
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_50eb79f00ce7c7de283afe810cad67c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_50eb79f00ce7c7de283afe810cad67c9.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_37070c3276c77ce42c3e923f2d49f1e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_37070c3276c77ce42c3e923f2d49f1e0.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_cab164f87e85ff9d7c9137f8416c6c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_cab164f87e85ff9d7c9137f8416c6c0d.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_0e94f40571b964b1b141efd6f1923e07.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_0e94f40571b964b1b141efd6f1923e07.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_79d88117d11479b81846b2f81650cf28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_79d88117d11479b81846b2f81650cf28.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_dd81b4bd0206a1b05aebad92d10c8b11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_dd81b4bd0206a1b05aebad92d10c8b11.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_6cd85dee58ab1f4f58ba20f4b7736f20.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_6cd85dee58ab1f4f58ba20f4b7736f20.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_220c99556a19de33e51f93fb024be888.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_220c99556a19de33e51f93fb024be888.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_243e4df6e3a3691f800a2265d810c48b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_243e4df6e3a3691f800a2265d810c48b.jpg already downloaded
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F98%252F6898447d49890a9fcf2fa8c7647219cc%252Fpa%252FYP72685_c2adc9915fa099051b73d494d619832d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_c2adc9915fa099051b73d494d619832d.jpg already downloaded
2026-03-30 12:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99750173-9566-5a53-a7ae-c7af054be902, identifier: YP72685
2026-03-30 12:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99750173-9566-5a53-a7ae-c7af054be902 with identifier: YP72685
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 12:06:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99750173-9566-5a53-a7ae-c7af054be902 with identifier: YP72685
2026-03-30 12:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99750173-9566-5a53-a7ae-c7af054be902 with identifier: YP72685 to the API
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YP72685>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:13:45Z',
'fuel_type': 'gas',
'id': '99750173-9566-5a53-a7ae-c7af054be902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP72685',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 38502,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_50eb79f00ce7c7de283afe810cad67c9.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_37070c3276c77ce42c3e923f2d49f1e0.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_cab164f87e85ff9d7c9137f8416c6c0d.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_0e94f40571b964b1b141efd6f1923e07.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_79d88117d11479b81846b2f81650cf28.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_dd81b4bd0206a1b05aebad92d10c8b11.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_6cd85dee58ab1f4f58ba20f4b7736f20.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_220c99556a19de33e51f93fb024be888.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_243e4df6e3a3691f800a2265d810c48b.jpg',
'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_c2adc9915fa099051b73d494d619832d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_50eb79f00ce7c7de283afe810cad67c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_37070c3276c77ce42c3e923f2d49f1e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_cab164f87e85ff9d7c9137f8416c6c0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_0e94f40571b964b1b141efd6f1923e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_79d88117d11479b81846b2f81650cf28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_dd81b4bd0206a1b05aebad92d10c8b11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_6cd85dee58ab1f4f58ba20f4b7736f20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_220c99556a19de33e51f93fb024be888.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_243e4df6e3a3691f800a2265d810c48b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99750173-9566-5a53-a7ae-c7af054be902/99750173-9566-5a53-a7ae-c7af054be902_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/98/6898447d49890a9fcf2fa8c7647219cc/pa/YP72685_c2adc9915fa099051b73d494d619832d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2023}
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP72685%27 HTTP/1.1" 200 None
2026-03-30 12:06:51 [auto1.fr] INFO: Saving data for YP72685: {'created_time': 1774872411.495579, 'last_price_update_time': 1774872411.495588, 'auction_closing_time': 1774970025.0}
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP72685') HTTP/1.1" 204 0
2026-03-30 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ22847> (referer: https://www.auto1.com/v1/car-details-view/FJ22847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-03-30 12:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with scrape type 1
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_64daa4b19d2094a6be3cb15283767064.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_577b4baca12436c0803f5f09a270b8fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_08c89d731f1429ea55f965fad518d140.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg not downloaded yet
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg not downloaded yet
2026-03-30 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC26231> (referer: https://www.auto1.com/v1/car-details-view/FC26231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with identifier: FC26231
2026-03-30 12:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with scrape type 1
2026-03-30 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_81b903d944837c532a63d61c6226e3e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_81b903d944837c532a63d61c6226e3e9.jpg not downloaded yet
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_b26475d18633044a18e98ad931524d87.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_b26475d18633044a18e98ad931524d87.jpg not downloaded yet
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_1191a7f51ae7029549a43f2624929a46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_1191a7f51ae7029549a43f2624929a46.jpg not downloaded yet
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg not downloaded yet
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_95e3e7a6df46291293b7fc2df7334fed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_95e3e7a6df46291293b7fc2df7334fed.jpg not downloaded yet
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg not downloaded yet
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15fcd0>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_95e3e7a6df46291293b7fc2df7334fed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0faba10>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac60990>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_95e3e7a6df46291293b7fc2df7334fed.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_95e3e7a6df46291293b7fc2df7334fed.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_1191a7f51ae7029549a43f2624929a46.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab5ad90>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_b26475d18633044a18e98ad931524d87.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac3f990>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_1191a7f51ae7029549a43f2624929a46.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_1191a7f51ae7029549a43f2624929a46.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_81b903d944837c532a63d61c6226e3e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1c9bd0>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_b26475d18633044a18e98ad931524d87.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_b26475d18633044a18e98ad931524d87.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c6590>
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F06%252F57069e00f4cea4de01bb42b86077e1db%252Fpa%252FFC26231_81b903d944837c532a63d61c6226e3e9.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_81b903d944837c532a63d61c6226e3e9.jpg saved to cache
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4
2026-03-30 12:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4, skipping ID generation
2026-03-30 12:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with scrape type 1
2026-03-30 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 sending to next pipeline
2026-03-30 12:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4, identifier: FC26231
2026-03-30 12:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with identifier: FC26231
2026-03-30 12:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with identifier: FC26231
2026-03-30 12:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4072b3ce-0e4c-53cf-ba5b-49385e8632d4 with identifier: FC26231 to the API
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_81b903d944837c532a63d61c6226e3e9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:51:51Z',
'fuel_type': 'petrol',
'id': '4072b3ce-0e4c-53cf-ba5b-49385e8632d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC26231',
'listing': 'auction',
'location': 'FR, Châtillon',
'make': 'Smart',
'model': 'fortwo',
'odometer': 93701,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_81b903d944837c532a63d61c6226e3e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_b26475d18633044a18e98ad931524d87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_1191a7f51ae7029549a43f2624929a46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_a9e8f13182c69e38dbc04f14b20fca1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_95e3e7a6df46291293b7fc2df7334fed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4072b3ce-0e4c-53cf-ba5b-49385e8632d4/4072b3ce-0e4c-53cf-ba5b-49385e8632d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 14942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/06/57069e00f4cea4de01bb42b86077e1db/pa/FC26231_125a18f2b5a5b4f0a89809ade28e07b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-06',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2010}
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC26231%27 HTTP/1.1" 200 None
2026-03-30 12:06:56 [auto1.fr] INFO: Saving data for FC26231: {'created_time': 1774872416.463014, 'last_price_update_time': 1774872416.463026, 'auction_closing_time': 1774972311.0}
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC26231') HTTP/1.1" 204 0
2026-03-30 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd01a3110>
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg saved to cache
2026-03-30 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1e8f50>
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg saved to cache
2026-03-30 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac3f090>
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dd390>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1c9a10>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_08c89d731f1429ea55f965fad518d140.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dc510>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_577b4baca12436c0803f5f09a270b8fd.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24c3d0>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac3e090>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b5cd0>
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F08%252Fa508d0eb11d84b9cd3a449371c18cb57%252Fpa%252FFJ22847_64daa4b19d2094a6be3cb15283767064.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg saved to cache
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-03-30 12:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07, skipping ID generation
2026-03-30 12:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with scrape type 1
2026-03-30 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 sending to next pipeline
2026-03-30 12:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07, identifier: FJ22847
2026-03-30 12:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-03-30 12:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-03-30 12:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847 to the API
2026-03-30 12:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:02:22Z',
'fuel_type': 'diesel',
'id': 'c4194d53-9dc6-5c4c-9ae3-65ebbc567e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ22847',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Peugeot',
'model': '2008',
'odometer': 200195,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2481483,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504965,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2423417,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4194d53-9dc6-5c4c-9ae3-65ebbc567e07/c4194d53-9dc6-5c4c-9ae3-65ebbc567e07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538827,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2017}
2026-03-30 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ22847%27 HTTP/1.1" 200 None
2026-03-30 12:06:59 [auto1.fr] INFO: Saving data for FJ22847: {'created_time': 1774872419.351073, 'last_price_update_time': 1774872419.351084, 'auction_closing_time': 1774969342.0}
2026-03-30 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ22847') HTTP/1.1" 204 0
2026-03-30 12:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD84445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ52141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP01929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR50273> (referer: https://www.auto1.com/v1/car-details-view/CR50273/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b509a85-e310-51df-abca-cd4ebe9ec751 with identifier: CR50273
2026-03-30 12:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b509a85-e310-51df-abca-cd4ebe9ec751 with scrape type 1
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg not downloaded yet
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_742820279d1659d5190350c795f2a567.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_742820279d1659d5190350c795f2a567.jpg not downloaded yet
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_24b31bf284d43ae3004abec20361338c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_24b31bf284d43ae3004abec20361338c.jpg not downloaded yet
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg not downloaded yet
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_9867441f3e239f0b566b05fe7eaf431e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9867441f3e239f0b566b05fe7eaf431e.jpg not downloaded yet
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_4a0b743150fa587810dd1568a9e3091f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_4a0b743150fa587810dd1568a9e3091f.jpg not downloaded yet
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB11849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_4a0b743150fa587810dd1568a9e3091f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9867441f3e239f0b566b05fe7eaf431e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b3510>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_4a0b743150fa587810dd1568a9e3091f.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_4a0b743150fa587810dd1568a9e3091f.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dccd0>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_9867441f3e239f0b566b05fe7eaf431e.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9867441f3e239f0b566b05fe7eaf431e.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ96172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_24b31bf284d43ae3004abec20361338c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca19ac10>
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg saved to cache
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab5ae50>
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_24b31bf284d43ae3004abec20361338c.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_24b31bf284d43ae3004abec20361338c.jpg saved to cache
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF56944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_742820279d1659d5190350c795f2a567.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f56d0>
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_742820279d1659d5190350c795f2a567.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_742820279d1659d5190350c795f2a567.jpg saved to cache
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca199c10>
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F23%252F59234838a61680f1281f68ea37798bf8%252Fpa%252FCR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg saved to cache
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b509a85-e310-51df-abca-cd4ebe9ec751
2026-03-30 12:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b509a85-e310-51df-abca-cd4ebe9ec751, skipping ID generation
2026-03-30 12:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b509a85-e310-51df-abca-cd4ebe9ec751 with scrape type 1
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b509a85-e310-51df-abca-cd4ebe9ec751 sending to next pipeline
2026-03-30 12:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3b509a85-e310-51df-abca-cd4ebe9ec751, identifier: CR50273
2026-03-30 12:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3b509a85-e310-51df-abca-cd4ebe9ec751 with identifier: CR50273
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 12:07:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3b509a85-e310-51df-abca-cd4ebe9ec751 with identifier: CR50273
2026-03-30 12:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3b509a85-e310-51df-abca-cd4ebe9ec751 with identifier: CR50273 to the API
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:29:15Z',
'fuel_type': 'diesel',
'id': '3b509a85-e310-51df-abca-cd4ebe9ec751',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR50273',
'listing': 'auction',
'location': 'FR, Chalon-sur-Saône',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 256492,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9fa95e726bd4d8ecf3a8ab58945e62fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_742820279d1659d5190350c795f2a567.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_24b31bf284d43ae3004abec20361338c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_92eb1c68fcfae400ec2de66e9a7ba67e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_9867441f3e239f0b566b05fe7eaf431e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b509a85-e310-51df-abca-cd4ebe9ec751/3b509a85-e310-51df-abca-cd4ebe9ec751_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/23/59234838a61680f1281f68ea37798bf8/pa/CR50273_4a0b743150fa587810dd1568a9e3091f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR50273%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [auto1.fr] INFO: Saving data for CR50273: {'created_time': 1774872437.511915, 'last_price_update_time': 1774872437.511925, 'auction_closing_time': 1774970955.0}
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR50273') HTTP/1.1" 204 0
2026-03-30 12:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG78882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.556(s), this was the 2nd time calling it.
2026-03-30 12:07:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.329891629963213 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR90965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.955(s), this was the 1st time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.5457726493217345 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.495(s), this was the 1st time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.257684840637867 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.069(s), this was the 1st time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.363465182530469 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.737(s), this was the 1st time calling it.
2026-03-30 12:07:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.768561137979214 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY08586/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:48 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 13 pages/min), scraped 86 items (at 5 items/min)
2026-03-30 12:07:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH55510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:48 [scrapy.extensions.logstats] INFO: Crawled 104 pages (at 1 pages/min), scraped 86 items (at 0 items/min)
2026-03-30 12:08:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK23512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.687(s), this was the 1st time calling it.
2026-03-30 12:09:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.1942581316600895 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.572(s), this was the 1st time calling it.
2026-03-30 12:09:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.1477646043270875 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 404.771(s), this was the 3rd time calling it.
2026-03-30 12:09:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.859413699700024 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF69474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB11849> (referer: https://www.auto1.com/v1/car-details-view/BB11849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.963(s), this was the 1st time calling it.
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.454827601470635 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5882765b-451e-5db0-a3d6-988af8c56f47 with identifier: BB11849
2026-03-30 12:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5882765b-451e-5db0-a3d6-988af8c56f47 with scrape type 1
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5882765b-451e-5db0-a3d6-988af8c56f47
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_0c0f9eff93dc7269860f6c26a3f4c8f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_0c0f9eff93dc7269860f6c26a3f4c8f8.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_c623525db7c35a356579fa0050a8f0c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_c623525db7c35a356579fa0050a8f0c2.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_7a94d531296bab43949b40c6da9c2751.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_7a94d531296bab43949b40c6da9c2751.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_b462833b39a505544d190977c35a52ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b462833b39a505544d190977c35a52ce.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_b0b1fc4e969434326c074df909e58780.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b0b1fc4e969434326c074df909e58780.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_947cc4a11a8cb1aa1736aee3da4f0c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_947cc4a11a8cb1aa1736aee3da4f0c0c.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_4c2c887191bf16bcba3fea1c9ee3ff7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_4c2c887191bf16bcba3fea1c9ee3ff7f.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_fad89d8433c892cc04bf20ffa91e8da3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_fad89d8433c892cc04bf20ffa91e8da3.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_98e91b59a49b1c7a99d135d9ee8ec3c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_98e91b59a49b1c7a99d135d9ee8ec3c5.jpg already downloaded
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F1c%252F141c6d89f74320c93ee8bd31482543c6%252Fpa%252FBB11849_25524350e7641940f1da9d4482c8b0f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_25524350e7641940f1da9d4482c8b0f6.jpg already downloaded
2026-03-30 12:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5882765b-451e-5db0-a3d6-988af8c56f47, identifier: BB11849
2026-03-30 12:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5882765b-451e-5db0-a3d6-988af8c56f47 with identifier: BB11849
2026-03-30 12:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5882765b-451e-5db0-a3d6-988af8c56f47 with identifier: BB11849
2026-03-30 12:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5882765b-451e-5db0-a3d6-988af8c56f47 with identifier: BB11849 to the API
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB11849>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:04:46Z',
'fuel_type': 'petrol',
'id': '5882765b-451e-5db0-a3d6-988af8c56f47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB11849',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'BMW',
'model': '2er',
'odometer': 73131,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_0c0f9eff93dc7269860f6c26a3f4c8f8.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_c623525db7c35a356579fa0050a8f0c2.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_7a94d531296bab43949b40c6da9c2751.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b462833b39a505544d190977c35a52ce.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b0b1fc4e969434326c074df909e58780.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_947cc4a11a8cb1aa1736aee3da4f0c0c.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_4c2c887191bf16bcba3fea1c9ee3ff7f.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_fad89d8433c892cc04bf20ffa91e8da3.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_98e91b59a49b1c7a99d135d9ee8ec3c5.jpg',
'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_25524350e7641940f1da9d4482c8b0f6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_0c0f9eff93dc7269860f6c26a3f4c8f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_c623525db7c35a356579fa0050a8f0c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_7a94d531296bab43949b40c6da9c2751.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b462833b39a505544d190977c35a52ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_b0b1fc4e969434326c074df909e58780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_947cc4a11a8cb1aa1736aee3da4f0c0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_4c2c887191bf16bcba3fea1c9ee3ff7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_fad89d8433c892cc04bf20ffa91e8da3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_98e91b59a49b1c7a99d135d9ee8ec3c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5882765b-451e-5db0-a3d6-988af8c56f47/5882765b-451e-5db0-a3d6-988af8c56f47_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/1c/141c6d89f74320c93ee8bd31482543c6/pa/BB11849_25524350e7641940f1da9d4482c8b0f6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-11',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2er 218i Gran Coupe M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB11849%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [auto1.fr] INFO: Saving data for BB11849: {'created_time': 1774872584.506382, 'last_price_update_time': 1774872584.506393, 'auction_closing_time': 1774969486.0}
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BB11849') HTTP/1.1" 204 0
2026-03-30 12:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ96172> (referer: https://www.auto1.com/v1/car-details-view/KJ96172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with identifier: KJ96172
2026-03-30 12:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with scrape type 1
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_66f400e66ac093cb88935bb21b269b49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_66f400e66ac093cb88935bb21b269b49.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_75fe31cff6f004db5594a45b01af465b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_75fe31cff6f004db5594a45b01af465b.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_3a1fc27357f1806d878d44afde326530.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_3a1fc27357f1806d878d44afde326530.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_e8379f7718d27c1c79879fee638c7374.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_e8379f7718d27c1c79879fee638c7374.jpg not downloaded yet
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg not downloaded yet
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_cb21f27772baa37a9e59126e9419741b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_cb21f27772baa37a9e59126e9419741b.jpg not downloaded yet
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg not downloaded yet
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac60310>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg saved to cache
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2edc50>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg saved to cache
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_cb21f27772baa37a9e59126e9419741b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22f290>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_cb21f27772baa37a9e59126e9419741b.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_cb21f27772baa37a9e59126e9419741b.jpg saved to cache
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0d9eb10>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg saved to cache
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_e8379f7718d27c1c79879fee638c7374.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22e890>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_e8379f7718d27c1c79879fee638c7374.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_e8379f7718d27c1c79879fee638c7374.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_3a1fc27357f1806d878d44afde326530.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f89d0>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_3a1fc27357f1806d878d44afde326530.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_3a1fc27357f1806d878d44afde326530.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_75fe31cff6f004db5594a45b01af465b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14b710>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_75fe31cff6f004db5594a45b01af465b.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_75fe31cff6f004db5594a45b01af465b.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1067d0>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca11ab90>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_66f400e66ac093cb88935bb21b269b49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7da50>
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fa0%252Feba0601ce255f7e5e65dde468cef1dad%252Fpa%252FKJ96172_66f400e66ac093cb88935bb21b269b49.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_66f400e66ac093cb88935bb21b269b49.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae
2026-03-30 12:09:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae, skipping ID generation
2026-03-30 12:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with scrape type 1
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae sending to next pipeline
2026-03-30 12:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae, identifier: KJ96172
2026-03-30 12:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with identifier: KJ96172
2026-03-30 12:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with identifier: KJ96172
2026-03-30 12:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2aa96a1e-c845-5d20-b4e1-cf91de5dcfae with identifier: KJ96172 to the API
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_66f400e66ac093cb88935bb21b269b49.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:02:29Z',
'fuel_type': 'petrol',
'id': '2aa96a1e-c845-5d20-b4e1-cf91de5dcfae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96172',
'listing': 'auction',
'location': 'FR, Fresnes',
'make': 'Fiat',
'model': '500',
'odometer': 28924,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_efeb2ba309292b4bad0d3ad34c33fc99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_66f400e66ac093cb88935bb21b269b49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_2ffb51a23999a8b79428a4f5a9ff3650.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_0dd2427d5092dccfe3b26d6746486b9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_75fe31cff6f004db5594a45b01af465b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_3a1fc27357f1806d878d44afde326530.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_e8379f7718d27c1c79879fee638c7374.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_d1dee738ac42c2c9c0c5f51d92ebd2ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_cb21f27772baa37a9e59126e9419741b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa96a1e-c845-5d20-b4e1-cf91de5dcfae/2aa96a1e-c845-5d20-b4e1-cf91de5dcfae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/a0/eba0601ce255f7e5e65dde468cef1dad/pa/KJ96172_a5740e389ff6b6b00a31d4e0da4ee500.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Rockstar',
'transmission': 'automatic',
'trim': 'Rockstar',
'year': 2019}
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ96172%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [auto1.fr] INFO: Saving data for KJ96172: {'created_time': 1774872588.353918, 'last_price_update_time': 1774872588.353928, 'auction_closing_time': 1774969349.0}
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ96172') HTTP/1.1" 204 0
2026-03-30 12:09:48 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 4 pages/min), scraped 88 items (at 2 items/min)
2026-03-30 12:09:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY95112> (referer: https://www.auto1.com/v1/car-details-view/UY95112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2615fc3b-dd6d-560f-8216-3e285e738293 with identifier: UY95112
2026-03-30 12:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2615fc3b-dd6d-560f-8216-3e285e738293 with scrape type 1
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_95c8243319bae0d92cf63f67d37bf220.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_95c8243319bae0d92cf63f67d37bf220.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_f2ae5a253f6a04f1b361263fe3218805.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f2ae5a253f6a04f1b361263fe3218805.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_430533aabb35fc492f2ca1d59b4805c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_430533aabb35fc492f2ca1d59b4805c3.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_f54db9d827c75312feb00b2bc0635624.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f54db9d827c75312feb00b2bc0635624.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_763263d2cc9476ac6500da54d9c85eb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_763263d2cc9476ac6500da54d9c85eb0.jpg not downloaded yet
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_95c8243319bae0d92cf63f67d37bf220.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_fef573c58b52b6e64955595c634878da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_fef573c58b52b6e64955595c634878da.jpg not downloaded yet
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg not downloaded yet
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_763263d2cc9476ac6500da54d9c85eb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f2ae5a253f6a04f1b361263fe3218805.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac64bd0>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_95c8243319bae0d92cf63f67d37bf220.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_95c8243319bae0d92cf63f67d37bf220.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_fef573c58b52b6e64955595c634878da.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7cc50>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_763263d2cc9476ac6500da54d9c85eb0.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_763263d2cc9476ac6500da54d9c85eb0.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13ca90>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_f2ae5a253f6a04f1b361263fe3218805.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f2ae5a253f6a04f1b361263fe3218805.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca241fd0>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13ee50>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_fef573c58b52b6e64955595c634878da.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_fef573c58b52b6e64955595c634878da.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0c8f950>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f54db9d827c75312feb00b2bc0635624.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_430533aabb35fc492f2ca1d59b4805c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca242410>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab42f90>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_f54db9d827c75312feb00b2bc0635624.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f54db9d827c75312feb00b2bc0635624.jpg saved to cache
2026-03-30 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc8790>
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg saved to cache
2026-03-30 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e5e50>
2026-03-30 12:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F38%252F7338b503b68528006fbdcdc859334aaf%252Fpa%252FUY95112_430533aabb35fc492f2ca1d59b4805c3.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_430533aabb35fc492f2ca1d59b4805c3.jpg saved to cache
2026-03-30 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2615fc3b-dd6d-560f-8216-3e285e738293
2026-03-30 12:09:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2615fc3b-dd6d-560f-8216-3e285e738293, skipping ID generation
2026-03-30 12:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2615fc3b-dd6d-560f-8216-3e285e738293 with scrape type 1
2026-03-30 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2615fc3b-dd6d-560f-8216-3e285e738293 sending to next pipeline
2026-03-30 12:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2615fc3b-dd6d-560f-8216-3e285e738293, identifier: UY95112
2026-03-30 12:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2615fc3b-dd6d-560f-8216-3e285e738293 with identifier: UY95112
2026-03-30 12:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2615fc3b-dd6d-560f-8216-3e285e738293 with identifier: UY95112
2026-03-30 12:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2615fc3b-dd6d-560f-8216-3e285e738293 with identifier: UY95112 to the API
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_430533aabb35fc492f2ca1d59b4805c3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 195,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:47:11Z',
'fuel_type': 'diesel',
'id': '2615fc3b-dd6d-560f-8216-3e285e738293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95112',
'listing': 'auction',
'location': 'FR',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 133421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_95c8243319bae0d92cf63f67d37bf220.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f2ae5a253f6a04f1b361263fe3218805.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_430533aabb35fc492f2ca1d59b4805c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_f54db9d827c75312feb00b2bc0635624.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4241bdf35ea0c4e7b8777f6458d19833.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_5e046e3a3059e34ad26c9cb47bf77109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_dc514a512f1fe862b2232f8bfb135d5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_763263d2cc9476ac6500da54d9c85eb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_fef573c58b52b6e64955595c634878da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2615fc3b-dd6d-560f-8216-3e285e738293/2615fc3b-dd6d-560f-8216-3e285e738293_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/38/7338b503b68528006fbdcdc859334aaf/pa/UY95112_4b3bab6b90d4f20568b654ce32a4ee3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-23',
'seats_number': 3,
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI SELECT RWD kompakt',
'transmission': 'automatic',
'trim': 'SELECT RWD kompakt',
'year': 2022}
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY95112%27 HTTP/1.1" 200 None
2026-03-30 12:09:54 [auto1.fr] INFO: Saving data for UY95112: {'created_time': 1774872594.544916, 'last_price_update_time': 1774872594.544925, 'auction_closing_time': 1774972031.0}
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY95112') HTTP/1.1" 204 0
2026-03-30 12:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG43753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.659(s), this was the 2nd time calling it.
2026-03-30 12:09:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.309059699251425 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.615(s), this was the 1st time calling it.
2026-03-30 12:09:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.053157223470468 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL33771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG78882> (referer: https://www.auto1.com/v1/car-details-view/KG78882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7026cd-4568-5cf4-a488-9619d84555bb with identifier: KG78882
2026-03-30 12:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7026cd-4568-5cf4-a488-9619d84555bb with scrape type 1
2026-03-30 12:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_7651432daa472dfed6bbb633a545e9b5.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_7651432daa472dfed6bbb633a545e9b5.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_532c0ac4e27ebcae97c1faef749f1630.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_532c0ac4e27ebcae97c1faef749f1630.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_cc2cac8cd9bc184da772c969d54350d7.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_cc2cac8cd9bc184da772c969d54350d7.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_8f998c4d220405589ef41b25f80e6424.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8f998c4d220405589ef41b25f80e6424.png not downloaded yet
2026-03-30 12:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_676da7284274779ba74b7f9abf36916a.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_676da7284274779ba74b7f9abf36916a.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png not downloaded yet
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_3123867cf347552245b85259327e9c07.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_3123867cf347552245b85259327e9c07.png not downloaded yet
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_532c0ac4e27ebcae97c1faef749f1630.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png not downloaded yet
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_7651432daa472dfed6bbb633a545e9b5.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_3123867cf347552245b85259327e9c07.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26de90>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_1.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_532c0ac4e27ebcae97c1faef749f1630.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_532c0ac4e27ebcae97c1faef749f1630.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_676da7284274779ba74b7f9abf36916a.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca243910>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_0.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_7651432daa472dfed6bbb633a545e9b5.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_7651432daa472dfed6bbb633a545e9b5.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7e4d0>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_8.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_3123867cf347552245b85259327e9c07.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_3123867cf347552245b85259327e9c07.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca118990>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_7.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca242550>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_9.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d5710>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_6.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_676da7284274779ba74b7f9abf36916a.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_676da7284274779ba74b7f9abf36916a.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8f998c4d220405589ef41b25f80e6424.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_cc2cac8cd9bc184da772c969d54350d7.png> (referer: https://www.auto1.com/)
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2587d0>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_5.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12d050>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_4.png HTTP/1.1" 201 0
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_8f998c4d220405589ef41b25f80e6424.png') HTTP/1.1" 204 0
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8f998c4d220405589ef41b25f80e6424.png saved to cache
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:10:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ec890>
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_2.png HTTP/1.1" 201 0
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png') HTTP/1.1" 204 0
2026-03-30 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png saved to cache
2026-03-30 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:10:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f3710>
2026-03-30 12:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_3.png HTTP/1.1" 201 0
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F4b%252F1e4bfe8b60e23e224b09319977a21b06%252Fpa%252FKG78882_cc2cac8cd9bc184da772c969d54350d7.png') HTTP/1.1" 204 0
2026-03-30 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_cc2cac8cd9bc184da772c969d54350d7.png saved to cache
2026-03-30 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a7026cd-4568-5cf4-a488-9619d84555bb
2026-03-30 12:10:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a7026cd-4568-5cf4-a488-9619d84555bb, skipping ID generation
2026-03-30 12:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7026cd-4568-5cf4-a488-9619d84555bb with scrape type 1
2026-03-30 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a7026cd-4568-5cf4-a488-9619d84555bb sending to next pipeline
2026-03-30 12:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a7026cd-4568-5cf4-a488-9619d84555bb, identifier: KG78882
2026-03-30 12:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a7026cd-4568-5cf4-a488-9619d84555bb with identifier: KG78882
2026-03-30 12:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a7026cd-4568-5cf4-a488-9619d84555bb with identifier: KG78882
2026-03-30 12:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a7026cd-4568-5cf4-a488-9619d84555bb with identifier: KG78882 to the API
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_cc2cac8cd9bc184da772c969d54350d7.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:17:23Z',
'fuel_type': 'petrol',
'id': '2a7026cd-4568-5cf4-a488-9619d84555bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG78882',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 12936,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 668473,
'Height': 547,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_7651432daa472dfed6bbb633a545e9b5.png',
'Width': 739},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_532c0ac4e27ebcae97c1faef749f1630.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 1057561,
'Height': 546,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_5cdc44f55dd04a8b768d7f84f6f16a87.png',
'Width': 742},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_cc2cac8cd9bc184da772c969d54350d7.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 681022,
'Height': 546,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8f998c4d220405589ef41b25f80e6424.png',
'Width': 736},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 605752,
'Height': 547,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_1ef4974bc3c9c2bf3dfc8c345c3eff1b.png',
'Width': 727},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_676da7284274779ba74b7f9abf36916a.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_0ae580a8ae302a4fba1e5ee6886d6ac4.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 707239,
'Height': 649,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_3123867cf347552245b85259327e9c07.png',
'Width': 888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7026cd-4568-5cf4-a488-9619d84555bb/2a7026cd-4568-5cf4-a488-9619d84555bb_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img1e/4b/1e4bfe8b60e23e224b09319977a21b06/pa/KG78882_8df1a68bba11a3c6432812f9cbd7d3ad.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG78882%27 HTTP/1.1" 200 None
2026-03-30 12:10:05 [auto1.fr] INFO: Saving data for KG78882: {'created_time': 1774872605.95754, 'last_price_update_time': 1774872605.957554, 'auction_closing_time': 1774970243.0}
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KG78882') HTTP/1.1" 204 0
2026-03-30 12:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:10:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.624(s), this was the 1st time calling it.
2026-03-30 12:10:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.103425301853979 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD84445> (referer: https://www.auto1.com/v1/car-details-view/GD84445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13ed045-bd63-573b-8305-fdec6a456d64 with identifier: GD84445
2026-03-30 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13ed045-bd63-573b-8305-fdec6a456d64 with scrape type 1
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_772b72718887ea1a2f0e63072e227130.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_772b72718887ea1a2f0e63072e227130.jpg not downloaded yet
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg not downloaded yet
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_59ab28314c3d3098c7010c61307004d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_59ab28314c3d3098c7010c61307004d6.jpg not downloaded yet
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg not downloaded yet
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_395d94c62f6baf21684a380a6311f393.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_395d94c62f6baf21684a380a6311f393.jpg not downloaded yet
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_b3c8612537bae9059517d58efc9a1940.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_b3c8612537bae9059517d58efc9a1940.jpg not downloaded yet
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_772b72718887ea1a2f0e63072e227130.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_59ab28314c3d3098c7010c61307004d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_395d94c62f6baf21684a380a6311f393.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab5b590>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_772b72718887ea1a2f0e63072e227130.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_772b72718887ea1a2f0e63072e227130.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24e9d0>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac3cad0>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_59ab28314c3d3098c7010c61307004d6.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_59ab28314c3d3098c7010c61307004d6.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_b3c8612537bae9059517d58efc9a1940.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac3fe50>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_395d94c62f6baf21684a380a6311f393.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_395d94c62f6baf21684a380a6311f393.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b0610>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_b3c8612537bae9059517d58efc9a1940.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_b3c8612537bae9059517d58efc9a1940.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26d610>
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F6c%252Ff26c208491f0e904132b9be4c1e0e909%252Fpa%252FGD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg saved to cache
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d13ed045-bd63-573b-8305-fdec6a456d64
2026-03-30 12:10:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d13ed045-bd63-573b-8305-fdec6a456d64, skipping ID generation
2026-03-30 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13ed045-bd63-573b-8305-fdec6a456d64 with scrape type 1
2026-03-30 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d13ed045-bd63-573b-8305-fdec6a456d64 sending to next pipeline
2026-03-30 12:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d13ed045-bd63-573b-8305-fdec6a456d64, identifier: GD84445
2026-03-30 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d13ed045-bd63-573b-8305-fdec6a456d64 with identifier: GD84445
2026-03-30 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d13ed045-bd63-573b-8305-fdec6a456d64 with identifier: GD84445
2026-03-30 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d13ed045-bd63-573b-8305-fdec6a456d64 with identifier: GD84445 to the API
2026-03-30 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:39:59Z',
'fuel_type': 'diesel',
'id': 'd13ed045-bd63-573b-8305-fdec6a456d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD84445',
'listing': 'auction',
'location': 'FR, VEZIN-LE-COQUET',
'make': 'Renault',
'model': 'Megane',
'odometer': 300869,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_772b72718887ea1a2f0e63072e227130.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_1d03fbb55ef10ee6e1cfa19659fdadfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_59ab28314c3d3098c7010c61307004d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_fb7adb8f75d40c986c7b05a5c4f20ef1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_395d94c62f6baf21684a380a6311f393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13ed045-bd63-573b-8305-fdec6a456d64/d13ed045-bd63-573b-8305-fdec6a456d64_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/6c/f26c208491f0e904132b9be4c1e0e909/pa/GD84445_b3c8612537bae9059517d58efc9a1940.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2011}
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84445%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [auto1.fr] INFO: Saving data for GD84445: {'created_time': 1774872618.301784, 'last_price_update_time': 1774872618.301793, 'auction_closing_time': 1774971599.0}
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD84445') HTTP/1.1" 204 0
2026-03-30 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ52141> (referer: https://www.auto1.com/v1/car-details-view/YJ52141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd655d9-5616-5971-bc58-69e6cb50c6f1 with identifier: YJ52141
2026-03-30 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd655d9-5616-5971-bc58-69e6cb50c6f1 with scrape type 1
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item efd655d9-5616-5971-bc58-69e6cb50c6f1
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_9d25917e06872a4203914272e1970a7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d25917e06872a4203914272e1970a7f.jpg already downloaded
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_9d668e6987f64b65fb389a40abcb38e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d668e6987f64b65fb389a40abcb38e3.jpg already downloaded
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_f7a3ad09ff240549947b15535fefc89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_f7a3ad09ff240549947b15535fefc89d.jpg already downloaded
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_8940a9e9ef1a742d5deaf4d98d4ce887.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_8940a9e9ef1a742d5deaf4d98d4ce887.jpg already downloaded
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_e320b56563c7508f2c6de9014fa8e45a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_e320b56563c7508f2c6de9014fa8e45a.jpg already downloaded
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fde%252F94debb84485e9251a4136fdbd8b39931%252Fpa%252FYJ52141_762444be8468eeebee540054c8a20574.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_762444be8468eeebee540054c8a20574.jpg already downloaded
2026-03-30 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: efd655d9-5616-5971-bc58-69e6cb50c6f1, identifier: YJ52141
2026-03-30 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: efd655d9-5616-5971-bc58-69e6cb50c6f1 with identifier: YJ52141
2026-03-30 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: efd655d9-5616-5971-bc58-69e6cb50c6f1 with identifier: YJ52141
2026-03-30 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: efd655d9-5616-5971-bc58-69e6cb50c6f1 with identifier: YJ52141 to the API
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ52141>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 103,
'expiration_date': '2026-03-31T15:36:09Z',
'fuel_type': 'diesel',
'id': 'efd655d9-5616-5971-bc58-69e6cb50c6f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ52141',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Nissan',
'model': 'Qashqai+2',
'odometer': 224335,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d25917e06872a4203914272e1970a7f.jpg',
'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d668e6987f64b65fb389a40abcb38e3.jpg',
'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_f7a3ad09ff240549947b15535fefc89d.jpg',
'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_8940a9e9ef1a742d5deaf4d98d4ce887.jpg',
'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_e320b56563c7508f2c6de9014fa8e45a.jpg',
'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_762444be8468eeebee540054c8a20574.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d25917e06872a4203914272e1970a7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_9d668e6987f64b65fb389a40abcb38e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_f7a3ad09ff240549947b15535fefc89d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_8940a9e9ef1a742d5deaf4d98d4ce887.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_e320b56563c7508f2c6de9014fa8e45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd655d9-5616-5971-bc58-69e6cb50c6f1/efd655d9-5616-5971-bc58-69e6cb50c6f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/de/94debb84485e9251a4136fdbd8b39931/pa/YJ52141_762444be8468eeebee540054c8a20574.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-08-20',
'seats_number': 7,
'seller_name': None,
'title': 'Nissan Qashqai+2 1.5 dCi Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2009}
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ52141%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [auto1.fr] INFO: Saving data for YJ52141: {'created_time': 1774872623.263731, 'last_price_update_time': 1774872623.263744, 'auction_closing_time': 1774971369.0}
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ52141') HTTP/1.1" 204 0
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK23512> (referer: https://www.auto1.com/v1/car-details-view/FK23512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd9446f-70eb-5262-af14-d7af5ad4d367 with identifier: FK23512
2026-03-30 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd9446f-70eb-5262-af14-d7af5ad4d367 with scrape type 1
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_3c17bd614ee3338012ca1316bf7d1725.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_3c17bd614ee3338012ca1316bf7d1725.jpg not downloaded yet
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_06096753ff6f50505128735cba4f928c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_06096753ff6f50505128735cba4f928c.jpg not downloaded yet
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_1231524195785f8a79677a763b0adb06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_1231524195785f8a79677a763b0adb06.jpg not downloaded yet
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg not downloaded yet
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg not downloaded yet
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_59011254f88e11b667cb65f5efc52a7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_59011254f88e11b667cb65f5efc52a7f.jpg not downloaded yet
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_3c17bd614ee3338012ca1316bf7d1725.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_06096753ff6f50505128735cba4f928c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_1231524195785f8a79677a763b0adb06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc1950>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_3c17bd614ee3338012ca1316bf7d1725.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_3c17bd614ee3338012ca1316bf7d1725.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca259b10>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_06096753ff6f50505128735cba4f928c.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_06096753ff6f50505128735cba4f928c.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7fd10>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_1231524195785f8a79677a763b0adb06.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_1231524195785f8a79677a763b0adb06.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca18d850>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_59011254f88e11b667cb65f5efc52a7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab5ba10>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca25a110>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0f%252F390fb68324f833a7e35eb9739a97839c%252Fpa%252FFK23512_59011254f88e11b667cb65f5efc52a7f.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_59011254f88e11b667cb65f5efc52a7f.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acd9446f-70eb-5262-af14-d7af5ad4d367
2026-03-30 12:10:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acd9446f-70eb-5262-af14-d7af5ad4d367, skipping ID generation
2026-03-30 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd9446f-70eb-5262-af14-d7af5ad4d367 with scrape type 1
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acd9446f-70eb-5262-af14-d7af5ad4d367 sending to next pipeline
2026-03-30 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: acd9446f-70eb-5262-af14-d7af5ad4d367, identifier: FK23512
2026-03-30 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: acd9446f-70eb-5262-af14-d7af5ad4d367 with identifier: FK23512
2026-03-30 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: acd9446f-70eb-5262-af14-d7af5ad4d367 with identifier: FK23512
2026-03-30 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: acd9446f-70eb-5262-af14-d7af5ad4d367 with identifier: FK23512 to the API
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_59011254f88e11b667cb65f5efc52a7f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:40:07Z',
'fuel_type': 'diesel',
'id': 'acd9446f-70eb-5262-af14-d7af5ad4d367',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK23512',
'listing': 'auction',
'location': 'FR, Sainte-Geneviève-des-Bois',
'make': 'Peugeot',
'model': '208',
'odometer': 306089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_3c17bd614ee3338012ca1316bf7d1725.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_06096753ff6f50505128735cba4f928c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_1231524195785f8a79677a763b0adb06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_c351760b6476cdcc337f3aecf32fe0f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_5300d12cedf055f37eb45e55eb64e3a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acd9446f-70eb-5262-af14-d7af5ad4d367/acd9446f-70eb-5262-af14-d7af5ad4d367_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/0f/390fb68324f833a7e35eb9739a97839c/pa/FK23512_59011254f88e11b667cb65f5efc52a7f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2012}
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK23512%27 HTTP/1.1" 200 None
2026-03-30 12:10:25 [auto1.fr] INFO: Saving data for FK23512: {'created_time': 1774872625.941346, 'last_price_update_time': 1774872625.941357, 'auction_closing_time': 1774971607.0}
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK23512') HTTP/1.1" 204 0
2026-03-30 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:29 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 5707 | hits on page: 40
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: LG92938
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: WA37151
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: TC10044
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: JR90965
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: PS40774
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: KG78882
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG78882%27 HTTP/1.1" 200 None
2026-03-30 12:10:29 [auto1.fr] INFO: Scrape type for KG78882: 0
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: BG48993
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: YH25205
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: SN49390
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: JP51471
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: BU72908
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU72908%27 HTTP/1.1" 200 None
2026-03-30 12:10:29 [auto1.fr] INFO: Scrape type for BU72908: 1
2026-03-30 12:10:29 [auto1.fr] INFO: Found listing with ID: AY02939
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY02939%27 HTTP/1.1" 200 None
2026-03-30 12:10:29 [auto1.fr] INFO: Scrape type for AY02939: 2
2026-03-30 12:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with identifier: AY02939
2026-03-30 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with scrape type 2
2026-03-30 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with scrape type 2
2026-03-30 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0c7b6ea-bc0c-5ccf-b702-e5faae63e847, identifier: AY02939
2026-03-30 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with identifier: AY02939
2026-03-30 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with identifier: AY02939
2026-03-30 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0c7b6ea-bc0c-5ccf-b702-e5faae63e847 with identifier: AY02939 to the API
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-31T15:57:08Z',
'fuel_type': 'diesel',
'id': 'b0c7b6ea-bc0c-5ccf-b702-e5faae63e847',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY02939',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 139086,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-19',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 TD Sd4 Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2018}
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY02939%27 HTTP/1.1" 200 None
2026-03-30 12:10:30 [auto1.fr] INFO: Saving data for AY02939: {'auction_closing_time': 1774972628.0, 'created_time': 1773295249.490209, 'last_price_update_time': 1774872630.416321}
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY02939') HTTP/1.1" 204 0
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: DY99826
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: JZ63677
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: FL10010
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: YL40024
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: MT51030
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: SM29883
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM29883%27 HTTP/1.1" 200 None
2026-03-30 12:10:30 [auto1.fr] INFO: Scrape type for SM29883: 1
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: TL51918
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL51918%27 HTTP/1.1" 200 None
2026-03-30 12:10:30 [auto1.fr] INFO: Scrape type for TL51918: 1
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: DY24427
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: GZ98158
2026-03-30 12:10:30 [auto1.fr] INFO: Found listing with ID: ZY65236
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY65236%27 HTTP/1.1" 200 None
2026-03-30 12:10:30 [auto1.fr] INFO: Scrape type for ZY65236: 2
2026-03-30 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4357a54-0dd4-5acf-a679-5a6ea31968f0 with identifier: ZY65236
2026-03-30 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4357a54-0dd4-5acf-a679-5a6ea31968f0 with scrape type 2
2026-03-30 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4357a54-0dd4-5acf-a679-5a6ea31968f0 with scrape type 2
2026-03-30 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4357a54-0dd4-5acf-a679-5a6ea31968f0, identifier: ZY65236
2026-03-30 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4357a54-0dd4-5acf-a679-5a6ea31968f0 with identifier: ZY65236
2026-03-30 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4357a54-0dd4-5acf-a679-5a6ea31968f0 with identifier: ZY65236
2026-03-30 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4357a54-0dd4-5acf-a679-5a6ea31968f0 with identifier: ZY65236 to the API
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-31T15:24:52Z',
'fuel_type': 'diesel',
'id': 'd4357a54-0dd4-5acf-a679-5a6ea31968f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY65236',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 255569,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-11',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 dCi Diesel Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2012}
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY65236%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Saving data for ZY65236: {'auction_closing_time': 1774970692.0, 'created_time': 1773335474.8687, 'last_price_update_time': 1774872631.008803}
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZY65236') HTTP/1.1" 204 0
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: GN48177
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN48177%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Scrape type for GN48177: 1
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: LR57312
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR57312%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Scrape type for LR57312: 1
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: KY87082
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: SM05006
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: FJ63732
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: TG43184
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: BR95734
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: NG62303
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG62303%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Scrape type for NG62303: 1
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: YW08307
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: YU71333
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93568%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Scrape type for GF93568: 1
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: CE47348
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: SC47506
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC47506%27 HTTP/1.1" 200 None
2026-03-30 12:10:31 [auto1.fr] INFO: Scrape type for SC47506: 1
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: FA55776
2026-03-30 12:10:31 [auto1.fr] INFO: Found listing with ID: RJ76526
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY08586> (referer: https://www.auto1.com/v1/car-details-view/KY08586/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF69474> (referer: https://www.auto1.com/v1/car-details-view/PF69474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f987872b-9f19-5154-86f6-22e9eeca5d86 with identifier: KY08586
2026-03-30 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987872b-9f19-5154-86f6-22e9eeca5d86 with scrape type 1
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f987872b-9f19-5154-86f6-22e9eeca5d86
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_3db9a054a709519b5dbb9c80acde9ee5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_3db9a054a709519b5dbb9c80acde9ee5.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_96b7c9cfec4a86b13062ddf97c2664d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_96b7c9cfec4a86b13062ddf97c2664d7.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_9f0a2a21f5c5565991bf793c9294d0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_9f0a2a21f5c5565991bf793c9294d0f4.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_768a93b2c8bbdbf20b7005845bc9c55a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_768a93b2c8bbdbf20b7005845bc9c55a.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_fecaed6490bce8fbc2455f590d22f05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_fecaed6490bce8fbc2455f590d22f05d.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_353eddf70aff5641c63e9c634bf9c096.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_353eddf70aff5641c63e9c634bf9c096.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_e63889f4df0acd26a0cfdbffdd2c77c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_e63889f4df0acd26a0cfdbffdd2c77c6.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_5f57895615f7efa6a2933cc8b52af472.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_5f57895615f7efa6a2933cc8b52af472.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_16ef442b15836889c1cc6eb01544dad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_16ef442b15836889c1cc6eb01544dad9.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa3%252F56a3021ed3217b0e25c73112deba40d2%252Fpa%252FKY08586_55b7cace04dbd50492cc691e9ebdf90f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_55b7cace04dbd50492cc691e9ebdf90f.jpg already downloaded
2026-03-30 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f987872b-9f19-5154-86f6-22e9eeca5d86, identifier: KY08586
2026-03-30 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f987872b-9f19-5154-86f6-22e9eeca5d86 with identifier: KY08586
2026-03-30 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f987872b-9f19-5154-86f6-22e9eeca5d86 with identifier: KY08586
2026-03-30 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f987872b-9f19-5154-86f6-22e9eeca5d86 with identifier: KY08586 to the API
2026-03-30 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY08586>
{'auction_title': '',
'c_o_2_emission_value': 197,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:16:21Z',
'fuel_type': 'diesel',
'id': 'f987872b-9f19-5154-86f6-22e9eeca5d86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY08586',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Koleos',
'odometer': 282455,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_3db9a054a709519b5dbb9c80acde9ee5.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_96b7c9cfec4a86b13062ddf97c2664d7.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_9f0a2a21f5c5565991bf793c9294d0f4.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_768a93b2c8bbdbf20b7005845bc9c55a.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_fecaed6490bce8fbc2455f590d22f05d.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_353eddf70aff5641c63e9c634bf9c096.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_e63889f4df0acd26a0cfdbffdd2c77c6.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_5f57895615f7efa6a2933cc8b52af472.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_16ef442b15836889c1cc6eb01544dad9.jpg',
'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_55b7cace04dbd50492cc691e9ebdf90f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_3db9a054a709519b5dbb9c80acde9ee5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_96b7c9cfec4a86b13062ddf97c2664d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_9f0a2a21f5c5565991bf793c9294d0f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_768a93b2c8bbdbf20b7005845bc9c55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_fecaed6490bce8fbc2455f590d22f05d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_353eddf70aff5641c63e9c634bf9c096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_e63889f4df0acd26a0cfdbffdd2c77c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_5f57895615f7efa6a2933cc8b52af472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_16ef442b15836889c1cc6eb01544dad9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987872b-9f19-5154-86f6-22e9eeca5d86/f987872b-9f19-5154-86f6-22e9eeca5d86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a3/56a3021ed3217b0e25c73112deba40d2/pa/KY08586_55b7cace04dbd50492cc691e9ebdf90f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2008}
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY08586%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [auto1.fr] INFO: Saving data for KY08586: {'created_time': 1774872638.397952, 'last_price_update_time': 1774872638.397962, 'auction_closing_time': 1774970181.0}
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY08586') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with identifier: PF69474
2026-03-30 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with scrape type 1
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_d49f5002cf520ee898b7464e72d0d33f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_d49f5002cf520ee898b7464e72d0d33f.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_300683c89ce7514206d14563cca2d4ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_300683c89ce7514206d14563cca2d4ad.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_0c51de6119fb440e15294926fd3557b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_0c51de6119fb440e15294926fd3557b9.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_c23981ebf9685248b5af8ec6c0fba785.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_c23981ebf9685248b5af8ec6c0fba785.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_bef769899d89fd469bbb565c7fabaddb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_bef769899d89fd469bbb565c7fabaddb.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_38054b51634358ff1a1ff9796d041d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_38054b51634358ff1a1ff9796d041d66.jpg not downloaded yet
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg not downloaded yet
2026-03-30 12:10:48 [scrapy.extensions.logstats] INFO: Crawled 118 pages (at 10 pages/min), scraped 96 items (at 8 items/min)
2026-03-30 12:10:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:11:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.892(s), this was the 1st time calling it.
2026-03-30 12:11:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.481003666059277 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL33771> (referer: https://www.auto1.com/v1/car-details-view/BL33771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with identifier: BL33771
2026-03-30 12:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with scrape type 1
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_37a6bafebb3329a28f7234ef24a97676.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_37a6bafebb3329a28f7234ef24a97676.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_2e1ebb6608ebc476749db59900670d19.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2e1ebb6608ebc476749db59900670d19.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_48ff21926150fa55a4d51b5aa7d63757.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_48ff21926150fa55a4d51b5aa7d63757.jpg not downloaded yet
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_2b0d967ed3d67732065b204f4c014af2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2b0d967ed3d67732065b204f4c014af2.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_9b03f526cc7a71bdfb0e360103161609.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_9b03f526cc7a71bdfb0e360103161609.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_075e42c8f0743d42ea46647948f953a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_075e42c8f0743d42ea46647948f953a3.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_77709445b8c0388833d29f4864de84e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_77709445b8c0388833d29f4864de84e0.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_60a62a4490ea78905f61269b2cadea59.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_60a62a4490ea78905f61269b2cadea59.jpg not downloaded yet
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_48ff21926150fa55a4d51b5aa7d63757.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_999b2f35636517a08dc1c280ce1d53db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_999b2f35636517a08dc1c280ce1d53db.jpg not downloaded yet
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_8f633e20a92cc7b2930ba57b35898e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_8f633e20a92cc7b2930ba57b35898e35.jpg not downloaded yet
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca154090>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_60a62a4490ea78905f61269b2cadea59.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f13d0>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_48ff21926150fa55a4d51b5aa7d63757.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_48ff21926150fa55a4d51b5aa7d63757.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1e8b50>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_60a62a4490ea78905f61269b2cadea59.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_60a62a4490ea78905f61269b2cadea59.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_8f633e20a92cc7b2930ba57b35898e35.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_999b2f35636517a08dc1c280ce1d53db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12d050>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_8f633e20a92cc7b2930ba57b35898e35.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_8f633e20a92cc7b2930ba57b35898e35.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_77709445b8c0388833d29f4864de84e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e3190>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_999b2f35636517a08dc1c280ce1d53db.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_999b2f35636517a08dc1c280ce1d53db.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_075e42c8f0743d42ea46647948f953a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12c4d0>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_77709445b8c0388833d29f4864de84e0.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_77709445b8c0388833d29f4864de84e0.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_9b03f526cc7a71bdfb0e360103161609.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12d290>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_075e42c8f0743d42ea46647948f953a3.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_075e42c8f0743d42ea46647948f953a3.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2b0d967ed3d67732065b204f4c014af2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2975d0>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_9b03f526cc7a71bdfb0e360103161609.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_9b03f526cc7a71bdfb0e360103161609.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2e1ebb6608ebc476749db59900670d19.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ece90>
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_2b0d967ed3d67732065b204f4c014af2.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2b0d967ed3d67732065b204f4c014af2.jpg saved to cache
2026-03-30 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_37a6bafebb3329a28f7234ef24a97676.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22edd0>
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_2e1ebb6608ebc476749db59900670d19.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2e1ebb6608ebc476749db59900670d19.jpg saved to cache
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_38054b51634358ff1a1ff9796d041d66.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d1710>
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F59%252F8a59eff794bf4d883b090f81a1ecfc3d%252Fpa%252FBL33771_37a6bafebb3329a28f7234ef24a97676.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_37a6bafebb3329a28f7234ef24a97676.jpg saved to cache
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660
2026-03-30 12:11:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660, skipping ID generation
2026-03-30 12:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with scrape type 1
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 sending to next pipeline
2026-03-30 12:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660, identifier: BL33771
2026-03-30 12:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with identifier: BL33771
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-30 12:11:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with identifier: BL33771
2026-03-30 12:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a4bf0cc-1bc2-50e0-8789-73fa028d4660 with identifier: BL33771 to the API
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_37a6bafebb3329a28f7234ef24a97676.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'purple',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:37:43Z',
'fuel_type': 'diesel',
'id': '2a4bf0cc-1bc2-50e0-8789-73fa028d4660',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL33771',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 197542,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_37a6bafebb3329a28f7234ef24a97676.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2e1ebb6608ebc476749db59900670d19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_48ff21926150fa55a4d51b5aa7d63757.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_2b0d967ed3d67732065b204f4c014af2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_9b03f526cc7a71bdfb0e360103161609.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_075e42c8f0743d42ea46647948f953a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_77709445b8c0388833d29f4864de84e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_60a62a4490ea78905f61269b2cadea59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_999b2f35636517a08dc1c280ce1d53db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4bf0cc-1bc2-50e0-8789-73fa028d4660/2a4bf0cc-1bc2-50e0-8789-73fa028d4660_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/59/8a59eff794bf4d883b090f81a1ecfc3d/pa/BL33771_8f633e20a92cc7b2930ba57b35898e35.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2020}
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL33771%27 HTTP/1.1" 200 None
2026-03-30 12:11:47 [auto1.fr] INFO: Saving data for BL33771: {'created_time': 1774872707.907631, 'last_price_update_time': 1774872707.907641, 'auction_closing_time': 1774971463.0}
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BL33771') HTTP/1.1" 204 0
2026-03-30 12:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_bef769899d89fd469bbb565c7fabaddb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14b010>
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_38054b51634358ff1a1ff9796d041d66.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_38054b51634358ff1a1ff9796d041d66.jpg saved to cache
2026-03-30 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7f2d0>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_bef769899d89fd469bbb565c7fabaddb.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_bef769899d89fd469bbb565c7fabaddb.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_c23981ebf9685248b5af8ec6c0fba785.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc43d0>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_c23981ebf9685248b5af8ec6c0fba785.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_c23981ebf9685248b5af8ec6c0fba785.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_0c51de6119fb440e15294926fd3557b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca18f850>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_300683c89ce7514206d14563cca2d4ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e0990>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_0c51de6119fb440e15294926fd3557b9.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_0c51de6119fb440e15294926fd3557b9.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca106b50>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_300683c89ce7514206d14563cca2d4ad.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_300683c89ce7514206d14563cca2d4ad.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_d49f5002cf520ee898b7464e72d0d33f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca119e10>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e06d0>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca118ed0>
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6e%252Fae6ec8de0d510546adf3367b4a0be226%252Fpa%252FPF69474_d49f5002cf520ee898b7464e72d0d33f.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_d49f5002cf520ee898b7464e72d0d33f.jpg saved to cache
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815
2026-03-30 12:11:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815, skipping ID generation
2026-03-30 12:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with scrape type 1
2026-03-30 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 sending to next pipeline
2026-03-30 12:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815, identifier: PF69474
2026-03-30 12:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with identifier: PF69474
2026-03-30 12:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with identifier: PF69474
2026-03-30 12:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815 with identifier: PF69474 to the API
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_d49f5002cf520ee898b7464e72d0d33f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:25:21Z',
'fuel_type': 'diesel',
'id': 'b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF69474',
'listing': 'auction',
'location': 'FR, Saint-Maur-des-Fossés',
'make': 'Audi',
'model': 'A5',
'odometer': 180304,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_d49f5002cf520ee898b7464e72d0d33f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_cc4d3298df623a83e9d4a1fff3b0767f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_06967f3e86c86fc8d9a6a6eea2ce0f96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_300683c89ce7514206d14563cca2d4ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_0c51de6119fb440e15294926fd3557b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_02a73dfe1d5c2d2608203b613cc31a7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_c23981ebf9685248b5af8ec6c0fba785.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_bef769899d89fd469bbb565c7fabaddb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_38054b51634358ff1a1ff9796d041d66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815/b0ce8c2b-ef4a-56d6-94ac-40b92d4b1815_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/6e/ae6ec8de0d510546adf3367b4a0be226/pa/PF69474_99493321ffe5fce9fc6de4ea1545be9b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-12',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-30 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF69474%27 HTTP/1.1" 200 None
2026-03-30 12:11:49 [auto1.fr] INFO: Saving data for PF69474: {'created_time': 1774872709.134655, 'last_price_update_time': 1774872709.134665, 'auction_closing_time': 1774970721.0}
2026-03-30 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF69474') HTTP/1.1" 204 0
2026-03-30 12:11:49 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 1 pages/min), scraped 98 items (at 2 items/min)
2026-03-30 12:11:49 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU72908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM29883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.038(s), this was the 1st time calling it.
2026-03-30 12:11:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6024326528873853 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL51918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF56944> (referer: https://www.auto1.com/v1/car-details-view/LF56944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN48177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35aad294-5791-57f0-9735-7c70a2f123a9 with identifier: LF56944
2026-03-30 12:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35aad294-5791-57f0-9735-7c70a2f123a9 with scrape type 1
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35aad294-5791-57f0-9735-7c70a2f123a9
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_66854b05816bf3514a511d011e1f49a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_66854b05816bf3514a511d011e1f49a6.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_be5c5e63ed2277458d7823898875e314.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_be5c5e63ed2277458d7823898875e314.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_53e01bad667816da89fcf8adbafd654f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_53e01bad667816da89fcf8adbafd654f.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_040d1fd8ff028a756cc30ebe0a39c6fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_040d1fd8ff028a756cc30ebe0a39c6fd.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_0a2c33f9968358ab07b77d35bb3cedf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_0a2c33f9968358ab07b77d35bb3cedf2.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_f454dbac6527a0e415e8c229b4b025bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_f454dbac6527a0e415e8c229b4b025bf.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_cff27dea1f4e520c78ef4aa091d7940a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cff27dea1f4e520c78ef4aa091d7940a.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_cc6a9444f0f7511dff2634a2af23e7a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cc6a9444f0f7511dff2634a2af23e7a9.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_26c4212b55b6718f4324adf9278db415.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_26c4212b55b6718f4324adf9278db415.jpg already downloaded
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fe5%252Fe9e57c55f171cc9334fddf17793a208e%252Fpa%252FLF56944_a4f40991181d71627ea4b867d1225889.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_a4f40991181d71627ea4b867d1225889.jpg already downloaded
2026-03-30 12:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35aad294-5791-57f0-9735-7c70a2f123a9, identifier: LF56944
2026-03-30 12:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35aad294-5791-57f0-9735-7c70a2f123a9 with identifier: LF56944
2026-03-30 12:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35aad294-5791-57f0-9735-7c70a2f123a9 with identifier: LF56944
2026-03-30 12:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35aad294-5791-57f0-9735-7c70a2f123a9 with identifier: LF56944 to the API
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF56944>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:05:40Z',
'fuel_type': 'petrol',
'id': '35aad294-5791-57f0-9735-7c70a2f123a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF56944',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 127120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_66854b05816bf3514a511d011e1f49a6.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_be5c5e63ed2277458d7823898875e314.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_53e01bad667816da89fcf8adbafd654f.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_040d1fd8ff028a756cc30ebe0a39c6fd.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_0a2c33f9968358ab07b77d35bb3cedf2.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_f454dbac6527a0e415e8c229b4b025bf.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cff27dea1f4e520c78ef4aa091d7940a.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cc6a9444f0f7511dff2634a2af23e7a9.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_26c4212b55b6718f4324adf9278db415.jpg',
'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_a4f40991181d71627ea4b867d1225889.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_66854b05816bf3514a511d011e1f49a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_be5c5e63ed2277458d7823898875e314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_53e01bad667816da89fcf8adbafd654f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_040d1fd8ff028a756cc30ebe0a39c6fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_0a2c33f9968358ab07b77d35bb3cedf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2672235,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_f454dbac6527a0e415e8c229b4b025bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cff27dea1f4e520c78ef4aa091d7940a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_cc6a9444f0f7511dff2634a2af23e7a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_26c4212b55b6718f4324adf9278db415.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35aad294-5791-57f0-9735-7c70a2f123a9/35aad294-5791-57f0-9735-7c70a2f123a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2764012,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/e5/e9e57c55f171cc9334fddf17793a208e/pa/LF56944_a4f40991181d71627ea4b867d1225889.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Carat Exclusive BMT',
'transmission': 'automatic',
'trim': 'Carat Exclusive BMT',
'year': 2019}
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF56944%27 HTTP/1.1" 200 None
2026-03-30 12:12:06 [auto1.fr] INFO: Saving data for LF56944: {'created_time': 1774872726.56337, 'last_price_update_time': 1774872726.563381, 'auction_closing_time': 1774969540.0}
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF56944') HTTP/1.1" 204 0
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.419(s), this was the 1st time calling it.
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.55371378313164 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR57312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC47506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.875(s), this was the 3rd time calling it.
2026-03-30 12:12:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.777391660239234 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG62303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU72908> (referer: https://www.auto1.com/v1/car-details-view/BU72908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 309d6eff-aac5-56bc-b87a-377ec50b5199 with identifier: BU72908
2026-03-30 12:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309d6eff-aac5-56bc-b87a-377ec50b5199 with scrape type 1
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_959106237c1d39c530bdbc39ced459db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_959106237c1d39c530bdbc39ced459db.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_da49ab248804f30fd2be36cfda65b575.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_da49ab248804f30fd2be36cfda65b575.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_3a108806c35e0227e3e755802b767eca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_3a108806c35e0227e3e755802b767eca.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_29532bdc2d7c99a099928bedb801a11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_29532bdc2d7c99a099928bedb801a11d.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_9dcfb940e72e85de63822914878fb6a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_9dcfb940e72e85de63822914878fb6a4.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_179e95d7f12523ca94c3f34e43c4812a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_179e95d7f12523ca94c3f34e43c4812a.jpg not downloaded yet
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_959106237c1d39c530bdbc39ced459db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_41add34cd7e010587dc6591e1773ef5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_41add34cd7e010587dc6591e1773ef5b.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg not downloaded yet
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_8de3cb9b521bee747f0058720a53d336.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_8de3cb9b521bee747f0058720a53d336.jpg not downloaded yet
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e2190>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_959106237c1d39c530bdbc39ced459db.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_959106237c1d39c530bdbc39ced459db.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_179e95d7f12523ca94c3f34e43c4812a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1559d0>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_179e95d7f12523ca94c3f34e43c4812a.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_179e95d7f12523ca94c3f34e43c4812a.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_da49ab248804f30fd2be36cfda65b575.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_8de3cb9b521bee747f0058720a53d336.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_3a108806c35e0227e3e755802b767eca.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_9dcfb940e72e85de63822914878fb6a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca148910>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_da49ab248804f30fd2be36cfda65b575.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_da49ab248804f30fd2be36cfda65b575.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_29532bdc2d7c99a099928bedb801a11d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7c990>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_8de3cb9b521bee747f0058720a53d336.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_8de3cb9b521bee747f0058720a53d336.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2fb810>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_41add34cd7e010587dc6591e1773ef5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca195a50>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_3a108806c35e0227e3e755802b767eca.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_3a108806c35e0227e3e755802b767eca.jpg saved to cache
2026-03-30 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca175050>
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_9dcfb940e72e85de63822914878fb6a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_9dcfb940e72e85de63822914878fb6a4.jpg saved to cache
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca263890>
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg saved to cache
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca260f10>
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_29532bdc2d7c99a099928bedb801a11d.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_29532bdc2d7c99a099928bedb801a11d.jpg saved to cache
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac722d0>
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F18%252Fa318899b6005fd4e6005c031ea6de75e%252Fpa%252FBU72908_41add34cd7e010587dc6591e1773ef5b.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_41add34cd7e010587dc6591e1773ef5b.jpg saved to cache
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 309d6eff-aac5-56bc-b87a-377ec50b5199
2026-03-30 12:12:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 309d6eff-aac5-56bc-b87a-377ec50b5199, skipping ID generation
2026-03-30 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309d6eff-aac5-56bc-b87a-377ec50b5199 with scrape type 1
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 309d6eff-aac5-56bc-b87a-377ec50b5199 sending to next pipeline
2026-03-30 12:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 309d6eff-aac5-56bc-b87a-377ec50b5199, identifier: BU72908
2026-03-30 12:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 309d6eff-aac5-56bc-b87a-377ec50b5199 with identifier: BU72908
2026-03-30 12:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 309d6eff-aac5-56bc-b87a-377ec50b5199 with identifier: BU72908
2026-03-30 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 309d6eff-aac5-56bc-b87a-377ec50b5199 with identifier: BU72908 to the API
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_41add34cd7e010587dc6591e1773ef5b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:36:55Z',
'fuel_type': 'diesel',
'id': '309d6eff-aac5-56bc-b87a-377ec50b5199',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU72908',
'listing': 'auction',
'location': 'FR, Laval',
'make': 'Peugeot',
'model': '5008',
'odometer': 140436,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_959106237c1d39c530bdbc39ced459db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_da49ab248804f30fd2be36cfda65b575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2757587,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_3a108806c35e0227e3e755802b767eca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_29532bdc2d7c99a099928bedb801a11d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2627680,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_dd3e403e2d8af22fd62573c66a174d2c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_9dcfb940e72e85de63822914878fb6a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_179e95d7f12523ca94c3f34e43c4812a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_41add34cd7e010587dc6591e1773ef5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_1d0c14128a0aa442f40bbed37141e1d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309d6eff-aac5-56bc-b87a-377ec50b5199/309d6eff-aac5-56bc-b87a-377ec50b5199_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/18/a318899b6005fd4e6005c031ea6de75e/pa/BU72908_8de3cb9b521bee747f0058720a53d336.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-26',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2018}
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU72908%27 HTTP/1.1" 200 None
2026-03-30 12:12:19 [auto1.fr] INFO: Saving data for BU72908: {'created_time': 1774872739.84578, 'last_price_update_time': 1774872739.845795, 'auction_closing_time': 1774971415.0}
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU72908') HTTP/1.1" 204 0
2026-03-30 12:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM29883> (referer: https://www.auto1.com/v1/car-details-view/SM29883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f11a856-5474-5b29-9077-3596fc1e85a7 with identifier: SM29883
2026-03-30 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f11a856-5474-5b29-9077-3596fc1e85a7 with scrape type 1
2026-03-30 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_fe5a962b7ac919dba0af7588eefbe633.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_fe5a962b7ac919dba0af7588eefbe633.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_23c5a7352b007163cd93c0d804124290.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_23c5a7352b007163cd93c0d804124290.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_d8e52e4cf356390979110523ec9f37fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d8e52e4cf356390979110523ec9f37fd.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg not downloaded yet
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_fe5a962b7ac919dba0af7588eefbe633.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg not downloaded yet
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_c1e5fa779303d227e7c002041c749ae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_c1e5fa779303d227e7c002041c749ae8.jpg not downloaded yet
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg not downloaded yet
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_23c5a7352b007163cd93c0d804124290.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0c40a50>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_fe5a962b7ac919dba0af7588eefbe633.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_fe5a962b7ac919dba0af7588eefbe633.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ee050>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac75c50>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_23c5a7352b007163cd93c0d804124290.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_23c5a7352b007163cd93c0d804124290.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac65250>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24f310>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca125c50>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0add310>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca144450>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_c1e5fa779303d227e7c002041c749ae8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d8e52e4cf356390979110523ec9f37fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b5f10>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_c1e5fa779303d227e7c002041c749ae8.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_c1e5fa779303d227e7c002041c749ae8.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0adcdd0>
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fda%252F54da242cd91c3130d2b2f2b1c82bf223%252Fpa%252FSM29883_d8e52e4cf356390979110523ec9f37fd.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d8e52e4cf356390979110523ec9f37fd.jpg saved to cache
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f11a856-5474-5b29-9077-3596fc1e85a7
2026-03-30 12:12:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f11a856-5474-5b29-9077-3596fc1e85a7, skipping ID generation
2026-03-30 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f11a856-5474-5b29-9077-3596fc1e85a7 with scrape type 1
2026-03-30 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f11a856-5474-5b29-9077-3596fc1e85a7 sending to next pipeline
2026-03-30 12:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2f11a856-5474-5b29-9077-3596fc1e85a7, identifier: SM29883
2026-03-30 12:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f11a856-5474-5b29-9077-3596fc1e85a7 with identifier: SM29883
2026-03-30 12:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f11a856-5474-5b29-9077-3596fc1e85a7 with identifier: SM29883
2026-03-30 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f11a856-5474-5b29-9077-3596fc1e85a7 with identifier: SM29883 to the API
2026-03-30 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d8e52e4cf356390979110523ec9f37fd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:36:59Z',
'fuel_type': 'petrol',
'id': '2f11a856-5474-5b29-9077-3596fc1e85a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM29883',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Peugeot',
'model': '308',
'odometer': 69655,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_fe5a962b7ac919dba0af7588eefbe633.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_7b9dc1cae31bb14216c4f2fe08ae2f3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_23c5a7352b007163cd93c0d804124290.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_47fb1daed1a4a8f20f79fdc00dada378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d8e52e4cf356390979110523ec9f37fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_21004e6d6ab6e7807ccc5549a2c0aadb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_66f37c20902f80d8ba6a13c2b1af9929.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_b993b5c24bbb9fec3cbed299131c5dad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_c1e5fa779303d227e7c002041c749ae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f11a856-5474-5b29-9077-3596fc1e85a7/2f11a856-5474-5b29-9077-3596fc1e85a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/da/54da242cd91c3130d2b2f2b1c82bf223/pa/SM29883_d34cad2ba43330f28c8cdfb98d3ede99.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Tech Edition',
'transmission': 'automatic',
'trim': 'Tech Edition',
'year': 2019}
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM29883%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [auto1.fr] INFO: Saving data for SM29883: {'created_time': 1774872742.079328, 'last_price_update_time': 1774872742.079339, 'auction_closing_time': 1774971419.0}
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM29883') HTTP/1.1" 204 0
2026-03-30 12:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP01929> (referer: https://www.auto1.com/v1/car-details-view/VP01929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with identifier: VP01929
2026-03-30 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with scrape type 1
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_f1e31cb3547ccf1495d9847bef25b216.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_f1e31cb3547ccf1495d9847bef25b216.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_ca979c008b89495489f4e97e3dc96057.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_ca979c008b89495489f4e97e3dc96057.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_9570599036b2a9284184de5070e41cd6.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_9570599036b2a9284184de5070e41cd6.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_b3152ab049f69ab6b54a4c3b706d7aff.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_b3152ab049f69ab6b54a4c3b706d7aff.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png not downloaded yet
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_3b983f5748a0b57c75cb5d1512a2c329.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_3b983f5748a0b57c75cb5d1512a2c329.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png not downloaded yet
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_8b78b9e02b1337edb0a0109a5d880361.png%27 HTTP/1.1" 200 None
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_8b78b9e02b1337edb0a0109a5d880361.png not downloaded yet
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_f1e31cb3547ccf1495d9847bef25b216.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a1c90>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_1.png HTTP/1.1" 201 0
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png') HTTP/1.1" 204 0
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png saved to cache
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_3b983f5748a0b57c75cb5d1512a2c329.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cea90>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_0.png HTTP/1.1" 201 0
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png') HTTP/1.1" 204 0
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png saved to cache
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0ae4550>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_6.png HTTP/1.1" 201 0
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png') HTTP/1.1" 204 0
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png saved to cache
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16e110>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_2.png HTTP/1.1" 201 0
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_f1e31cb3547ccf1495d9847bef25b216.png') HTTP/1.1" 204 0
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_f1e31cb3547ccf1495d9847bef25b216.png saved to cache
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca155290>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_7.png HTTP/1.1" 201 0
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_3b983f5748a0b57c75cb5d1512a2c329.png') HTTP/1.1" 204 0
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_3b983f5748a0b57c75cb5d1512a2c329.png saved to cache
2026-03-30 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_8b78b9e02b1337edb0a0109a5d880361.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_b3152ab049f69ab6b54a4c3b706d7aff.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_ca979c008b89495489f4e97e3dc96057.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_9570599036b2a9284184de5070e41cd6.png> (referer: https://www.auto1.com/)
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:12:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12f950>
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_8.png HTTP/1.1" 201 0
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png') HTTP/1.1" 204 0
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png saved to cache
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24f950>
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_9.png HTTP/1.1" 201 0
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_8b78b9e02b1337edb0a0109a5d880361.png') HTTP/1.1" 204 0
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_8b78b9e02b1337edb0a0109a5d880361.png saved to cache
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca105e90>
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_5.png HTTP/1.1" 201 0
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_b3152ab049f69ab6b54a4c3b706d7aff.png') HTTP/1.1" 204 0
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_b3152ab049f69ab6b54a4c3b706d7aff.png saved to cache
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d6150>
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_3.png HTTP/1.1" 201 0
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_ca979c008b89495489f4e97e3dc96057.png') HTTP/1.1" 204 0
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_ca979c008b89495489f4e97e3dc96057.png saved to cache
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:12:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9e2d0>
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_4.png HTTP/1.1" 201 0
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fbb%252F20bbd6d468e217bc54bee4ac31e533d7%252Fpa%252FVP01929_9570599036b2a9284184de5070e41cd6.png') HTTP/1.1" 204 0
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_9570599036b2a9284184de5070e41cd6.png saved to cache
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6
2026-03-30 12:12:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8640d1c7-1486-5f04-abcd-8cd5dce303b6, skipping ID generation
2026-03-30 12:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with scrape type 1
2026-03-30 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8640d1c7-1486-5f04-abcd-8cd5dce303b6 sending to next pipeline
2026-03-30 12:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8640d1c7-1486-5f04-abcd-8cd5dce303b6, identifier: VP01929
2026-03-30 12:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with identifier: VP01929
2026-03-30 12:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with identifier: VP01929
2026-03-30 12:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8640d1c7-1486-5f04-abcd-8cd5dce303b6 with identifier: VP01929 to the API
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_9570599036b2a9284184de5070e41cd6.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:08:08Z',
'fuel_type': 'petrol',
'id': '8640d1c7-1486-5f04-abcd-8cd5dce303b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP01929',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 7035,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 1025028,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_cb4ada0d9a6ec6cf80a6808dae087e74.png',
'Width': 727},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_1f70dbf34a2fb6b0a4debbd748bf0075.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 742491,
'Height': 547,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_f1e31cb3547ccf1495d9847bef25b216.png',
'Width': 733},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 1256239,
'Height': 588,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_ca979c008b89495489f4e97e3dc96057.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 810287,
'Height': 523,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_9570599036b2a9284184de5070e41cd6.png',
'Width': 721},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 850589,
'Height': 535,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_b3152ab049f69ab6b54a4c3b706d7aff.png',
'Width': 735},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_d20a7a2820fcf737d5a4fc2c89f20a61.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_3b983f5748a0b57c75cb5d1512a2c329.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 917881,
'Height': 655,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_fa8b7ac9af4515a8bf9fdea0beef6058.png',
'Width': 891},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8640d1c7-1486-5f04-abcd-8cd5dce303b6/8640d1c7-1486-5f04-abcd-8cd5dce303b6_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img20/bb/20bbd6d468e217bc54bee4ac31e533d7/pa/VP01929_8b78b9e02b1337edb0a0109a5d880361.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP01929%27 HTTP/1.1" 200 None
2026-03-30 12:12:23 [auto1.fr] INFO: Saving data for VP01929: {'created_time': 1774872743.896615, 'last_price_update_time': 1774872743.896626, 'auction_closing_time': 1774969688.0}
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VP01929') HTTP/1.1" 204 0
2026-03-30 12:12:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.613(s), this was the 1st time calling it.
2026-03-30 12:12:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.09690090448979 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL51918> (referer: https://www.auto1.com/v1/car-details-view/TL51918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with identifier: TL51918
2026-03-30 12:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with scrape type 1
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg not downloaded yet
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg not downloaded yet
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg not downloaded yet
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg not downloaded yet
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_f252e46d72d0bf785f4733de1541736d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f252e46d72d0bf785f4733de1541736d.jpg not downloaded yet
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg not downloaded yet
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f252e46d72d0bf785f4733de1541736d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bcc90>
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg saved to cache
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac658d0>
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg saved to cache
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ccdd0>
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg saved to cache
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922e110>
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg saved to cache
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b8fd0>
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_f252e46d72d0bf785f4733de1541736d.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f252e46d72d0bf785f4733de1541736d.jpg saved to cache
2026-03-30 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc5c10>
2026-03-30 12:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6e%252Ffd6e55c7a06c33a90a02ab75ffcd656f%252Fpa%252FTL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg saved to cache
2026-03-30 12:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072
2026-03-30 12:12:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec6e865a-f0a4-51d5-964b-b6fef0bb7072, skipping ID generation
2026-03-30 12:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with scrape type 1
2026-03-30 12:12:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec6e865a-f0a4-51d5-964b-b6fef0bb7072 sending to next pipeline
2026-03-30 12:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec6e865a-f0a4-51d5-964b-b6fef0bb7072, identifier: TL51918
2026-03-30 12:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with identifier: TL51918
2026-03-30 12:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with identifier: TL51918
2026-03-30 12:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec6e865a-f0a4-51d5-964b-b6fef0bb7072 with identifier: TL51918 to the API
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 222,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 232,
'expiration_date': '2026-03-31T15:22:14Z',
'fuel_type': 'diesel',
'id': 'ec6e865a-f0a4-51d5-964b-b6fef0bb7072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL51918',
'listing': 'auction',
'location': 'FR, Bourg-en-Bresse',
'make': 'Audi',
'model': 'A6',
'odometer': 276546,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f0ff7e60801915f28ca5924a175dc2a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_78ecb8c7d0792a05fbdcf3f83cac0448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_eb4f5b990ebd59fbd84ab01cff50bd31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_397d9cdbbab59d71c2bb8deeefdc04af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_f252e46d72d0bf785f4733de1541736d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec6e865a-f0a4-51d5-964b-b6fef0bb7072/ec6e865a-f0a4-51d5-964b-b6fef0bb7072_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/6e/fd6e55c7a06c33a90a02ab75ffcd656f/pa/TL51918_7921282c3a8e60eda5e1b1cc6aa4acfc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro Ambition',
'transmission': 'automatic',
'trim': 'quattro Ambition',
'year': 2008}
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL51918%27 HTTP/1.1" 200 None
2026-03-30 12:12:36 [auto1.fr] INFO: Saving data for TL51918: {'created_time': 1774872756.532138, 'last_price_update_time': 1774872756.532148, 'auction_closing_time': 1774970534.0}
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL51918') HTTP/1.1" 204 0
2026-03-30 12:12:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.127(s), this was the 1st time calling it.
2026-03-30 12:12:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.559407412931086 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.323(s), this was the 1st time calling it.
2026-03-30 12:12:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6203494650811563 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:48 [scrapy.extensions.logstats] INFO: Crawled 131 pages (at 12 pages/min), scraped 103 items (at 5 items/min)
2026-03-30 12:12:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR90965> (referer: https://www.auto1.com/v1/car-details-view/JR90965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57911ee8-138c-588b-8507-69741a4da4e0 with identifier: JR90965
2026-03-30 12:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57911ee8-138c-588b-8507-69741a4da4e0 with scrape type 1
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 57911ee8-138c-588b-8507-69741a4da4e0
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_72de8e91cde7a9ebf95488389b6ff9ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_72de8e91cde7a9ebf95488389b6ff9ba.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_0936679a901f4df721c30ddcc2102a68.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_0936679a901f4df721c30ddcc2102a68.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_4817ec653c7fcf347b1ad0795af07131.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_4817ec653c7fcf347b1ad0795af07131.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_848e4dd798b19d9148094bcf5a93c92c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_848e4dd798b19d9148094bcf5a93c92c.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_e8f9597e201ad3302773a6cb0a74f75c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_e8f9597e201ad3302773a6cb0a74f75c.jpg already downloaded
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb0%252Fc5b0f352cca26d80df8f31069d70fda4%252Fpa%252FJR90965_5a71546349f2e82734ece5e5a2cade91.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_5a71546349f2e82734ece5e5a2cade91.jpg already downloaded
2026-03-30 12:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57911ee8-138c-588b-8507-69741a4da4e0, identifier: JR90965
2026-03-30 12:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57911ee8-138c-588b-8507-69741a4da4e0 with identifier: JR90965
2026-03-30 12:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57911ee8-138c-588b-8507-69741a4da4e0 with identifier: JR90965
2026-03-30 12:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57911ee8-138c-588b-8507-69741a4da4e0 with identifier: JR90965 to the API
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR90965>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:26:37Z',
'fuel_type': 'diesel',
'id': '57911ee8-138c-588b-8507-69741a4da4e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR90965',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Renault',
'model': 'Megane',
'odometer': 231895,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_72de8e91cde7a9ebf95488389b6ff9ba.jpg',
'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_0936679a901f4df721c30ddcc2102a68.jpg',
'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_4817ec653c7fcf347b1ad0795af07131.jpg',
'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_848e4dd798b19d9148094bcf5a93c92c.jpg',
'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_e8f9597e201ad3302773a6cb0a74f75c.jpg',
'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_5a71546349f2e82734ece5e5a2cade91.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_72de8e91cde7a9ebf95488389b6ff9ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_0936679a901f4df721c30ddcc2102a68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_4817ec653c7fcf347b1ad0795af07131.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_848e4dd798b19d9148094bcf5a93c92c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_e8f9597e201ad3302773a6cb0a74f75c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57911ee8-138c-588b-8507-69741a4da4e0/57911ee8-138c-588b-8507-69741a4da4e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_5a71546349f2e82734ece5e5a2cade91.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR90965%27 HTTP/1.1" 200 None
2026-03-30 12:12:54 [auto1.fr] INFO: Saving data for JR90965: {'created_time': 1774872774.539691, 'last_price_update_time': 1774872774.539703, 'auction_closing_time': 1774970797.0}
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR90965') HTTP/1.1" 204 0
2026-03-30 12:13:48 [scrapy.extensions.logstats] INFO: Crawled 132 pages (at 1 pages/min), scraped 104 items (at 1 items/min)
2026-03-30 12:13:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG43753> (referer: https://www.auto1.com/v1/car-details-view/XG43753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 668c7037-588b-550e-8379-6dafab4fbd20 with identifier: XG43753
2026-03-30 12:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 668c7037-588b-550e-8379-6dafab4fbd20 with scrape type 1
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 668c7037-588b-550e-8379-6dafab4fbd20
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_3dea5c9ef7db9ae544e37dea16e67265.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_3dea5c9ef7db9ae544e37dea16e67265.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_36e03a6d3eecb3fefd81e79ca7a6b983.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_36e03a6d3eecb3fefd81e79ca7a6b983.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_f75eba60a9f6844cc39be93f7d3f54e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_f75eba60a9f6844cc39be93f7d3f54e9.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_191b16625120b801007ff150705e3766.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_191b16625120b801007ff150705e3766.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_b44c591a7be90a4ae6a8813345500cca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_b44c591a7be90a4ae6a8813345500cca.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_aeeb2d1c22f036a0a788a444f831256b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_aeeb2d1c22f036a0a788a444f831256b.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_fcb6f59f5039f0c3cdbfb8289d242251.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_fcb6f59f5039f0c3cdbfb8289d242251.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_e8cd49f6aca4698f7edec867f2e03c76.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_e8cd49f6aca4698f7edec867f2e03c76.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_1d7cf297e517c1e5bbac7b6e18702849.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_1d7cf297e517c1e5bbac7b6e18702849.jpg already downloaded
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff9%252F1df95deb9b896b64ff1ef2f07b15d931%252Fpa%252FXG43753_a01c28408017334463de7dcab69ea849.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_a01c28408017334463de7dcab69ea849.jpg already downloaded
2026-03-30 12:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 668c7037-588b-550e-8379-6dafab4fbd20, identifier: XG43753
2026-03-30 12:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 668c7037-588b-550e-8379-6dafab4fbd20 with identifier: XG43753
2026-03-30 12:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 668c7037-588b-550e-8379-6dafab4fbd20 with identifier: XG43753
2026-03-30 12:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 668c7037-588b-550e-8379-6dafab4fbd20 with identifier: XG43753 to the API
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XG43753>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:20:12Z',
'fuel_type': 'petrol',
'id': '668c7037-588b-550e-8379-6dafab4fbd20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG43753',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Citroen',
'model': 'C3',
'odometer': 58537,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_3dea5c9ef7db9ae544e37dea16e67265.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_36e03a6d3eecb3fefd81e79ca7a6b983.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_f75eba60a9f6844cc39be93f7d3f54e9.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_191b16625120b801007ff150705e3766.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_b44c591a7be90a4ae6a8813345500cca.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_aeeb2d1c22f036a0a788a444f831256b.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_fcb6f59f5039f0c3cdbfb8289d242251.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_e8cd49f6aca4698f7edec867f2e03c76.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_1d7cf297e517c1e5bbac7b6e18702849.jpg',
'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_a01c28408017334463de7dcab69ea849.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_3dea5c9ef7db9ae544e37dea16e67265.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_36e03a6d3eecb3fefd81e79ca7a6b983.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_f75eba60a9f6844cc39be93f7d3f54e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_191b16625120b801007ff150705e3766.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_b44c591a7be90a4ae6a8813345500cca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_aeeb2d1c22f036a0a788a444f831256b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648986,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_fcb6f59f5039f0c3cdbfb8289d242251.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_e8cd49f6aca4698f7edec867f2e03c76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_1d7cf297e517c1e5bbac7b6e18702849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668c7037-588b-550e-8379-6dafab4fbd20/668c7037-588b-550e-8379-6dafab4fbd20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/f9/1df95deb9b896b64ff1ef2f07b15d931/pa/XG43753_a01c28408017334463de7dcab69ea849.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG43753%27 HTTP/1.1" 200 None
2026-03-30 12:13:51 [auto1.fr] INFO: Saving data for XG43753: {'created_time': 1774872831.293749, 'last_price_update_time': 1774872831.293757, 'auction_closing_time': 1774970412.0}
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XG43753') HTTP/1.1" 204 0
2026-03-30 12:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG62303> (referer: https://www.auto1.com/v1/car-details-view/NG62303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58355ddb-aa19-5fe0-bccb-022975a490eb with identifier: NG62303
2026-03-30 12:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58355ddb-aa19-5fe0-bccb-022975a490eb with scrape type 1
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58355ddb-aa19-5fe0-bccb-022975a490eb
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_82269df406334792e8c0bb782870c339.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_82269df406334792e8c0bb782870c339.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_d117af3a94ed7b617c6edb9228bad4f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_d117af3a94ed7b617c6edb9228bad4f1.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_9bd6a499c4f32e39ec695a6fc8af5e1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9bd6a499c4f32e39ec695a6fc8af5e1e.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_114472adb75f7ce2eb1af1101c467fa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_114472adb75f7ce2eb1af1101c467fa8.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_1d698d378b74170e10c1d6e7fb4b6d98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1d698d378b74170e10c1d6e7fb4b6d98.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_cd3426789784aaaccd18f5a8b67c1b7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_cd3426789784aaaccd18f5a8b67c1b7c.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_1df6e2cae63456f9abd71b18d14294f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1df6e2cae63456f9abd71b18d14294f2.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_9940a76bed2b7ae50039f65ea76d5f44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9940a76bed2b7ae50039f65ea76d5f44.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_59bf6f72e1ddba36951c762188199138.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_59bf6f72e1ddba36951c762188199138.jpg already downloaded
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fd9%252F69d9712da98b1f7d3dc94290f07efd45%252Fpa%252FNG62303_56baad3043200dc13e9a140547d993ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_56baad3043200dc13e9a140547d993ce.jpg already downloaded
2026-03-30 12:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58355ddb-aa19-5fe0-bccb-022975a490eb, identifier: NG62303
2026-03-30 12:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58355ddb-aa19-5fe0-bccb-022975a490eb with identifier: NG62303
2026-03-30 12:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58355ddb-aa19-5fe0-bccb-022975a490eb with identifier: NG62303
2026-03-30 12:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58355ddb-aa19-5fe0-bccb-022975a490eb with identifier: NG62303 to the API
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG62303>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:20:36Z',
'fuel_type': 'petrol',
'id': '58355ddb-aa19-5fe0-bccb-022975a490eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG62303',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 109024,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_82269df406334792e8c0bb782870c339.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_d117af3a94ed7b617c6edb9228bad4f1.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9bd6a499c4f32e39ec695a6fc8af5e1e.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_114472adb75f7ce2eb1af1101c467fa8.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1d698d378b74170e10c1d6e7fb4b6d98.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_cd3426789784aaaccd18f5a8b67c1b7c.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1df6e2cae63456f9abd71b18d14294f2.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9940a76bed2b7ae50039f65ea76d5f44.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_59bf6f72e1ddba36951c762188199138.jpg',
'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_56baad3043200dc13e9a140547d993ce.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_82269df406334792e8c0bb782870c339.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_d117af3a94ed7b617c6edb9228bad4f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9bd6a499c4f32e39ec695a6fc8af5e1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_114472adb75f7ce2eb1af1101c467fa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1d698d378b74170e10c1d6e7fb4b6d98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_cd3426789784aaaccd18f5a8b67c1b7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_1df6e2cae63456f9abd71b18d14294f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_9940a76bed2b7ae50039f65ea76d5f44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_59bf6f72e1ddba36951c762188199138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58355ddb-aa19-5fe0-bccb-022975a490eb/58355ddb-aa19-5fe0-bccb-022975a490eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/d9/69d9712da98b1f7d3dc94290f07efd45/pa/NG62303_56baad3043200dc13e9a140547d993ce.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2026-03-30 12:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG62303%27 HTTP/1.1" 200 None
2026-03-30 12:13:53 [auto1.fr] INFO: Saving data for NG62303: {'created_time': 1774872833.076934, 'last_price_update_time': 1774872833.076946, 'auction_closing_time': 1774970436.0}
2026-03-30 12:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG62303') HTTP/1.1" 204 0
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:58 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 5719 | hits on page: 40
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: BR95734
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: NG62303
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG62303%27 HTTP/1.1" 200 None
2026-03-30 12:13:58 [auto1.fr] INFO: Scrape type for NG62303: 0
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: YW08307
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: YU71333
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 12:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: CE47348
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: SC47506
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: FA55776
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: RJ76526
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: PX29564
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: BP52149
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: SR29633
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: ER22482
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: TW16745
2026-03-30 12:13:58 [auto1.fr] INFO: Found listing with ID: VN64150
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN64150%27 HTTP/1.1" 200 None
2026-03-30 12:13:58 [auto1.fr] INFO: Scrape type for VN64150: 2
2026-03-30 12:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-03-30 12:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74465d5-a5b8-5286-bb20-a2da7567e227 with scrape type 2
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f74465d5-a5b8-5286-bb20-a2da7567e227 with scrape type 2
2026-03-30 12:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f74465d5-a5b8-5286-bb20-a2da7567e227, identifier: VN64150
2026-03-30 12:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-03-30 12:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-03-30 12:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150 to the API
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:12:42Z',
'fuel_type': 'diesel',
'id': 'f74465d5-a5b8-5286-bb20-a2da7567e227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN64150',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 178953,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-18',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN64150%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Saving data for VN64150: {'auction_closing_time': 1774969962.0, 'created_time': 1773664665.033507, 'last_price_update_time': 1774872839.114493}
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN64150') HTTP/1.1" 204 0
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: FK36448
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: FS93369
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: UB37186
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: TR84613
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: VX34217
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX34217%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for VX34217: 1
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: UC60343
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC60343%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for UC60343: 1
2026-03-30 12:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: DF41129
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: CD49178
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: AK18752
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: CC48181
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC48181%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for CC48181: 1
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: RG71541
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG71541%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for RG71541: 1
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: PW84769
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: UU20581
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU20581%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for UU20581: 2
2026-03-30 12:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c83114ad-4651-5c59-a235-155d15d218de with identifier: UU20581
2026-03-30 12:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c83114ad-4651-5c59-a235-155d15d218de with scrape type 2
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c83114ad-4651-5c59-a235-155d15d218de with scrape type 2
2026-03-30 12:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c83114ad-4651-5c59-a235-155d15d218de, identifier: UU20581
2026-03-30 12:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c83114ad-4651-5c59-a235-155d15d218de with identifier: UU20581
2026-03-30 12:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c83114ad-4651-5c59-a235-155d15d218de with identifier: UU20581
2026-03-30 12:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c83114ad-4651-5c59-a235-155d15d218de with identifier: UU20581 to the API
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:59:59Z',
'fuel_type': 'petrol',
'id': 'c83114ad-4651-5c59-a235-155d15d218de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU20581',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 107198,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-21',
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Grand Chic',
'transmission': 'automatic',
'trim': 'Grand Chic',
'year': 2019}
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU20581%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Saving data for UU20581: {'auction_closing_time': 1774972799.0, 'created_time': 1774299145.522016, 'last_price_update_time': 1774872839.775863}
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU20581') HTTP/1.1" 204 0
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: NS62449
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: SU26545
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: ZH11864
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: WW50830
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: UW11385
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW11385%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [auto1.fr] INFO: Scrape type for UW11385: 1
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: EY85679
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: GE12087
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: HR25538
2026-03-30 12:13:59 [auto1.fr] INFO: Found listing with ID: PB55961
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:07 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 5719 | hits on page: 40
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ61260%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Scrape type for AZ61260: 2
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with identifier: AZ61260
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f14ebfea-631d-53a8-bc76-3f7bde9fa8ee, identifier: AZ61260
2026-03-30 12:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with identifier: AZ61260
2026-03-30 12:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with identifier: AZ61260
2026-03-30 12:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f14ebfea-631d-53a8-bc76-3f7bde9fa8ee with identifier: AZ61260 to the API
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:07:18Z',
'fuel_type': 'diesel',
'id': 'f14ebfea-631d-53a8-bc76-3f7bde9fa8ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ61260',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 196331,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-23',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Campus Clim',
'transmission': 'manual',
'trim': 'Campus Clim',
'year': 2005}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ61260%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Saving data for AZ61260: {'auction_closing_time': 1774969638.0, 'created_time': 1774038747.923484, 'last_price_update_time': 1774872847.45136}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ61260') HTTP/1.1" 204 0
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: ER94333
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: WU73634
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU73634%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Scrape type for WU73634: 1
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: TZ86489
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: PV12001
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: VD06652
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD06652%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Scrape type for VD06652: 1
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: UV64510
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: SN68527
2026-03-30 12:14:07 [auto1.fr] INFO: Found listing with ID: XE23390
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE23390%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Scrape type for XE23390: 2
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0450193b-817b-542e-8f38-b4ba97dab0df with identifier: XE23390
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0450193b-817b-542e-8f38-b4ba97dab0df with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0450193b-817b-542e-8f38-b4ba97dab0df with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0450193b-817b-542e-8f38-b4ba97dab0df, identifier: XE23390
2026-03-30 12:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0450193b-817b-542e-8f38-b4ba97dab0df with identifier: XE23390
2026-03-30 12:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0450193b-817b-542e-8f38-b4ba97dab0df with identifier: XE23390
2026-03-30 12:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0450193b-817b-542e-8f38-b4ba97dab0df with identifier: XE23390 to the API
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:33Z',
'fuel_type': 'diesel',
'id': '0450193b-817b-542e-8f38-b4ba97dab0df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE23390',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 229463,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-13',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi Inventive Blue 2WD',
'transmission': 'manual',
'trim': 'Inventive Blue 2WD',
'year': 2014}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE23390%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Saving data for XE23390: {'auction_closing_time': 1774969293.0, 'created_time': 1773250833.144573, 'last_price_update_time': 1774872847.996384}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XE23390') HTTP/1.1" 204 0
2026-03-30 12:14:08 [auto1.fr] INFO: Found listing with ID: UL33581
2026-03-30 12:14:08 [auto1.fr] INFO: Found listing with ID: KT63849
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT63849%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.fr] INFO: Scrape type for KT63849: 2
2026-03-30 12:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b6cd05-b350-50b7-b130-aa71980b7693 with identifier: KT63849
2026-03-30 12:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b6cd05-b350-50b7-b130-aa71980b7693 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b6cd05-b350-50b7-b130-aa71980b7693 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9b6cd05-b350-50b7-b130-aa71980b7693, identifier: KT63849
2026-03-30 12:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9b6cd05-b350-50b7-b130-aa71980b7693 with identifier: KT63849
2026-03-30 12:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9b6cd05-b350-50b7-b130-aa71980b7693 with identifier: KT63849
2026-03-30 12:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9b6cd05-b350-50b7-b130-aa71980b7693 with identifier: KT63849 to the API
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:13:51Z',
'fuel_type': 'petrol',
'id': 'a9b6cd05-b350-50b7-b130-aa71980b7693',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT63849',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 173787,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-14',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT63849%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.fr] INFO: Saving data for KT63849: {'auction_closing_time': 1774970031.0, 'created_time': 1774269408.497785, 'last_price_update_time': 1774872848.606704}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KT63849') HTTP/1.1" 204 0
2026-03-30 12:14:08 [auto1.fr] INFO: Found listing with ID: GC83047
2026-03-30 12:14:08 [auto1.fr] INFO: Found listing with ID: LY86888
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY86888%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.fr] INFO: Scrape type for LY86888: 2
2026-03-30 12:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064aa486-e04e-5b9d-a2ab-5be041871849 with identifier: LY86888
2026-03-30 12:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064aa486-e04e-5b9d-a2ab-5be041871849 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 064aa486-e04e-5b9d-a2ab-5be041871849 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 064aa486-e04e-5b9d-a2ab-5be041871849, identifier: LY86888
2026-03-30 12:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 064aa486-e04e-5b9d-a2ab-5be041871849 with identifier: LY86888
2026-03-30 12:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 064aa486-e04e-5b9d-a2ab-5be041871849 with identifier: LY86888
2026-03-30 12:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 064aa486-e04e-5b9d-a2ab-5be041871849 with identifier: LY86888 to the API
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:19:01Z',
'fuel_type': 'petrol',
'id': '064aa486-e04e-5b9d-a2ab-5be041871849',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY86888',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 37578,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': None,
'title': 'Opel Corsa 1.4 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2015}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY86888%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Saving data for LY86888: {'auction_closing_time': 1774970341.0, 'created_time': 1773693559.33802, 'last_price_update_time': 1774872849.070553}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY86888') HTTP/1.1" 204 0
2026-03-30 12:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC47506> (referer: https://www.auto1.com/v1/car-details-view/SC47506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: RD85936
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: VT02723
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: GV35927
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: DE97231
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE97231%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Scrape type for DE97231: 1
2026-03-30 12:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: HC40418
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: KX63336
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: AV52301
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: MK51863
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: PJ68004
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: AG05913
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: AE64159
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE64159%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Scrape type for AE64159: 1
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: RZ51319
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: GG06949
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: DD12219
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD12219%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Scrape type for DD12219: 1
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: DS07902
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: GK41383
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: WR47867
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: ND41633
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: WJ51086
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: XT21215
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: AV23705
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV23705%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Scrape type for AV23705: 2
2026-03-30 12:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with identifier: AV23705
2026-03-30 12:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c, identifier: AV23705
2026-03-30 12:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with identifier: AV23705
2026-03-30 12:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with identifier: AV23705
2026-03-30 12:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c with identifier: AV23705 to the API
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:33:47Z',
'fuel_type': 'diesel',
'id': '09f6ecd4-3fa6-5460-af2e-ced0ab3ce08c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV23705',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Aircross',
'odometer': 150157,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-23',
'seller_name': None,
'title': 'Citroen C4 Aircross 1.6 HDi Exclusive 4WD',
'transmission': 'manual',
'trim': 'Exclusive 4WD',
'year': 2013}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV23705%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Saving data for AV23705: {'auction_closing_time': 1774971227.0, 'created_time': 1772950460.375228, 'last_price_update_time': 1774872849.597351}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV23705') HTTP/1.1" 204 0
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: LK92723
2026-03-30 12:14:09 [auto1.fr] INFO: Found listing with ID: VJ96213
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ96213%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.fr] INFO: Scrape type for VJ96213: 1
2026-03-30 12:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a2acda-bc09-5b04-bcd2-4044c593e3af with identifier: SC47506
2026-03-30 12:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a2acda-bc09-5b04-bcd2-4044c593e3af with scrape type 1
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83a2acda-bc09-5b04-bcd2-4044c593e3af
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_ede323f70c26588e170d91e4cb0d6fa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_ede323f70c26588e170d91e4cb0d6fa1.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_c4b4bbd25d19cf0c07b27742fcad5879.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_c4b4bbd25d19cf0c07b27742fcad5879.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_a043e07f6f972938ec7f7946bbf5dfe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_a043e07f6f972938ec7f7946bbf5dfe7.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_22eef2bb7f282a2710d5192a71a643d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_22eef2bb7f282a2710d5192a71a643d3.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_1aa6aa057859094a2f6988f73eb7b31b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_1aa6aa057859094a2f6988f73eb7b31b.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_bc33d4ea5b6837fd41c08c948982702b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_bc33d4ea5b6837fd41c08c948982702b.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_dc90b91bf6d542a61df044ee27a680d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_dc90b91bf6d542a61df044ee27a680d3.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_19988e01d7cefcac4903273362d5accd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_19988e01d7cefcac4903273362d5accd.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_b2540e92f378ea9fa9058a3ef4b3a5a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_b2540e92f378ea9fa9058a3ef4b3a5a8.jpg already downloaded
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5d%252Fb75d3e47abeb4923950bb170f5de1aa9%252Fpa%252FSC47506_92f9d342e4552d35508c42ba00f83cda.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_92f9d342e4552d35508c42ba00f83cda.jpg already downloaded
2026-03-30 12:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83a2acda-bc09-5b04-bcd2-4044c593e3af, identifier: SC47506
2026-03-30 12:14:10 [auto1.fr] INFO: Found listing with ID: RP51827
2026-03-30 12:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83a2acda-bc09-5b04-bcd2-4044c593e3af with identifier: SC47506
2026-03-30 12:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83a2acda-bc09-5b04-bcd2-4044c593e3af with identifier: SC47506
2026-03-30 12:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83a2acda-bc09-5b04-bcd2-4044c593e3af with identifier: SC47506 to the API
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC47506>
{'auction_title': '',
'c_o_2_emission_value': 194,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:28:26Z',
'fuel_type': 'diesel',
'id': '83a2acda-bc09-5b04-bcd2-4044c593e3af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC47506',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Master',
'odometer': 219149,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_ede323f70c26588e170d91e4cb0d6fa1.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_c4b4bbd25d19cf0c07b27742fcad5879.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_a043e07f6f972938ec7f7946bbf5dfe7.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_22eef2bb7f282a2710d5192a71a643d3.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_1aa6aa057859094a2f6988f73eb7b31b.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_bc33d4ea5b6837fd41c08c948982702b.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_dc90b91bf6d542a61df044ee27a680d3.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_19988e01d7cefcac4903273362d5accd.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_b2540e92f378ea9fa9058a3ef4b3a5a8.jpg',
'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_92f9d342e4552d35508c42ba00f83cda.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_ede323f70c26588e170d91e4cb0d6fa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_c4b4bbd25d19cf0c07b27742fcad5879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_a043e07f6f972938ec7f7946bbf5dfe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_22eef2bb7f282a2710d5192a71a643d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_1aa6aa057859094a2f6988f73eb7b31b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_bc33d4ea5b6837fd41c08c948982702b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_dc90b91bf6d542a61df044ee27a680d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_19988e01d7cefcac4903273362d5accd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_b2540e92f378ea9fa9058a3ef4b3a5a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a2acda-bc09-5b04-bcd2-4044c593e3af/83a2acda-bc09-5b04-bcd2-4044c593e3af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/5d/b75d3e47abeb4923950bb170f5de1aa9/pa/SC47506_92f9d342e4552d35508c42ba00f83cda.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-03',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H2 3,5 Grand Confort',
'transmission': 'manual',
'trim': 'L2H2 3,5 Grand Confort',
'year': 2017}
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC47506%27 HTTP/1.1" 200 None
2026-03-30 12:14:10 [auto1.fr] INFO: Saving data for SC47506: {'created_time': 1774872850.791893, 'last_price_update_time': 1774872850.791904, 'auction_closing_time': 1774970906.0}
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC47506') HTTP/1.1" 204 0
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC48181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC60343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG71541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.892(s), this was the 1st time calling it.
2026-03-30 12:14:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.998322228723506 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW11385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:26 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 5720 | hits on page: 40
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: RP51827
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: PH85075
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: XA18023
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA18023%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.fr] INFO: Scrape type for XA18023: 2
2026-03-30 12:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e8a781-fcb6-5ace-b760-a7e42bb033aa with identifier: XA18023
2026-03-30 12:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e8a781-fcb6-5ace-b760-a7e42bb033aa with scrape type 2
2026-03-30 12:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2e8a781-fcb6-5ace-b760-a7e42bb033aa with scrape type 2
2026-03-30 12:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d2e8a781-fcb6-5ace-b760-a7e42bb033aa, identifier: XA18023
2026-03-30 12:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d2e8a781-fcb6-5ace-b760-a7e42bb033aa with identifier: XA18023
2026-03-30 12:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d2e8a781-fcb6-5ace-b760-a7e42bb033aa with identifier: XA18023
2026-03-30 12:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d2e8a781-fcb6-5ace-b760-a7e42bb033aa with identifier: XA18023 to the API
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:40:20Z',
'fuel_type': 'diesel',
'id': 'd2e8a781-fcb6-5ace-b760-a7e42bb033aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA18023',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 114120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-24',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2008}
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA18023%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.fr] INFO: Saving data for XA18023: {'auction_closing_time': 1774971620.0, 'created_time': 1774299787.691107, 'last_price_update_time': 1774872866.877736}
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA18023') HTTP/1.1" 204 0
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: HX86868
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: CX79974
2026-03-30 12:14:26 [auto1.fr] INFO: Found listing with ID: TK98013
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK98013%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.fr] INFO: Scrape type for TK98013: 2
2026-03-30 12:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f6f0187-455f-5172-aba0-8be732391894 with identifier: TK98013
2026-03-30 12:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f6f0187-455f-5172-aba0-8be732391894 with scrape type 2
2026-03-30 12:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f6f0187-455f-5172-aba0-8be732391894 with scrape type 2
2026-03-30 12:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f6f0187-455f-5172-aba0-8be732391894, identifier: TK98013
2026-03-30 12:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f6f0187-455f-5172-aba0-8be732391894 with identifier: TK98013
2026-03-30 12:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f6f0187-455f-5172-aba0-8be732391894 with identifier: TK98013
2026-03-30 12:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f6f0187-455f-5172-aba0-8be732391894 with identifier: TK98013 to the API
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:17:13Z',
'fuel_type': 'diesel',
'id': '7f6f0187-455f-5172-aba0-8be732391894',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK98013',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 115350,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-23',
'seller_name': None,
'title': 'BMW 1er 116d Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2014}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK98013%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.fr] INFO: Saving data for TK98013: {'auction_closing_time': 1774970233.0, 'created_time': 1774091819.933569, 'last_price_update_time': 1774872867.517208}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK98013') HTTP/1.1" 204 0
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: CB26112
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: AM79434
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: ES35993
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: JT67860
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: NK27352
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: HN32336
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: VH99245
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: WD02529
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: EP20272
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: VE02752
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE02752%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.fr] INFO: Scrape type for VE02752: 1
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: AZ90567
2026-03-30 12:14:27 [auto1.fr] INFO: Found listing with ID: CL47015
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL47015%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.fr] INFO: Scrape type for CL47015: 2
2026-03-30 12:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with identifier: CL47015
2026-03-30 12:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with scrape type 2
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with scrape type 2
2026-03-30 12:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07490ab6-f602-56d6-9d6d-3d7f1e9807d8, identifier: CL47015
2026-03-30 12:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with identifier: CL47015
2026-03-30 12:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with identifier: CL47015
2026-03-30 12:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07490ab6-f602-56d6-9d6d-3d7f1e9807d8 with identifier: CL47015 to the API
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:26:07Z',
'fuel_type': 'diesel',
'id': '07490ab6-f602-56d6-9d6d-3d7f1e9807d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL47015',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 107183,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-07',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2016}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL47015%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Saving data for CL47015: {'auction_closing_time': 1774970767.0, 'created_time': 1774269886.1219, 'last_price_update_time': 1774872868.082847}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CL47015') HTTP/1.1" 204 0
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: KY03233
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: CW40670
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: JA68663
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: EP13062
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP13062%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Scrape type for EP13062: 1
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: KD39903
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD39903%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Scrape type for KD39903: 1
2026-03-30 12:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: GZ25721
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ25721%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Scrape type for GZ25721: 2
2026-03-30 12:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with identifier: GZ25721
2026-03-30 12:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with scrape type 2
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with scrape type 2
2026-03-30 12:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 447d7c6f-11e0-57db-bd79-07d6cd7868f0, identifier: GZ25721
2026-03-30 12:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with identifier: GZ25721
2026-03-30 12:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with identifier: GZ25721
2026-03-30 12:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 447d7c6f-11e0-57db-bd79-07d6cd7868f0 with identifier: GZ25721 to the API
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:10:08Z',
'fuel_type': 'diesel',
'id': '447d7c6f-11e0-57db-bd79-07d6cd7868f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ25721',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 264713,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-03',
'seller_name': None,
'title': 'Peugeot 5008 2.0 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2011}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ25721%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Saving data for GZ25721: {'auction_closing_time': 1774969808.0, 'created_time': 1773664687.841369, 'last_price_update_time': 1774872868.832158}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ25721') HTTP/1.1" 204 0
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: JU04159
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: ES16654
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: DE58917
2026-03-30 12:14:28 [auto1.fr] INFO: Found listing with ID: PY17725
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY17725%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Scrape type for PY17725: 2
2026-03-30 12:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e77839-9e44-5be1-af2c-34fb10add045 with identifier: PY17725
2026-03-30 12:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e77839-9e44-5be1-af2c-34fb10add045 with scrape type 2
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e77839-9e44-5be1-af2c-34fb10add045 with scrape type 2
2026-03-30 12:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75e77839-9e44-5be1-af2c-34fb10add045, identifier: PY17725
2026-03-30 12:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75e77839-9e44-5be1-af2c-34fb10add045 with identifier: PY17725
2026-03-30 12:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75e77839-9e44-5be1-af2c-34fb10add045 with identifier: PY17725
2026-03-30 12:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 75e77839-9e44-5be1-af2c-34fb10add045 with identifier: PY17725 to the API
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:06:50Z',
'fuel_type': 'petrol',
'id': '75e77839-9e44-5be1-af2c-34fb10add045',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY17725',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 82231,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY17725%27 HTTP/1.1" 200 None
2026-03-30 12:14:29 [auto1.fr] INFO: Saving data for PY17725: {'auction_closing_time': 1774969610.0, 'created_time': 1774298855.911194, 'last_price_update_time': 1774872869.366424}
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY17725') HTTP/1.1" 204 0
2026-03-30 12:14:29 [auto1.fr] INFO: Found listing with ID: NW77264
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW77264%27 HTTP/1.1" 200 None
2026-03-30 12:14:29 [auto1.fr] INFO: Scrape type for NW77264: 1
2026-03-30 12:14:29 [auto1.fr] INFO: Found listing with ID: SG94624
2026-03-30 12:14:29 [auto1.fr] INFO: Found listing with ID: CL78536
2026-03-30 12:14:29 [auto1.fr] INFO: Found listing with ID: YF33503
2026-03-30 12:14:29 [auto1.fr] INFO: Found listing with ID: GF84131
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF84131%27 HTTP/1.1" 200 None
2026-03-30 12:14:29 [auto1.fr] INFO: Scrape type for GF84131: 2
2026-03-30 12:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c808df03-1105-51bd-814c-32270d44b59e with identifier: GF84131
2026-03-30 12:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c808df03-1105-51bd-814c-32270d44b59e with scrape type 2
2026-03-30 12:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c808df03-1105-51bd-814c-32270d44b59e with scrape type 2
2026-03-30 12:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c808df03-1105-51bd-814c-32270d44b59e, identifier: GF84131
2026-03-30 12:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c808df03-1105-51bd-814c-32270d44b59e with identifier: GF84131
2026-03-30 12:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c808df03-1105-51bd-814c-32270d44b59e with identifier: GF84131
2026-03-30 12:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c808df03-1105-51bd-814c-32270d44b59e with identifier: GF84131 to the API
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 230,
'expiration_date': '2026-03-31T15:12:55Z',
'fuel_type': 'diesel',
'id': 'c808df03-1105-51bd-814c-32270d44b59e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF84131',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 293061,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-17',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF84131%27 HTTP/1.1" 200 None
2026-03-30 12:14:29 [auto1.fr] INFO: Saving data for GF84131: {'auction_closing_time': 1774969975.0, 'created_time': 1772989224.30391, 'last_price_update_time': 1774872869.94214}
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF84131') HTTP/1.1" 204 0
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: EZ54447
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: PY80925
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80925%27 HTTP/1.1" 200 None
2026-03-30 12:14:30 [auto1.fr] INFO: Scrape type for PY80925: 2
2026-03-30 12:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 397bec52-4d1e-5752-badc-48b342eeeca2 with identifier: PY80925
2026-03-30 12:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 397bec52-4d1e-5752-badc-48b342eeeca2 with scrape type 2
2026-03-30 12:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 397bec52-4d1e-5752-badc-48b342eeeca2 with scrape type 2
2026-03-30 12:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 397bec52-4d1e-5752-badc-48b342eeeca2, identifier: PY80925
2026-03-30 12:14:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 397bec52-4d1e-5752-badc-48b342eeeca2 with identifier: PY80925
2026-03-30 12:14:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 397bec52-4d1e-5752-badc-48b342eeeca2 with identifier: PY80925
2026-03-30 12:14:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 397bec52-4d1e-5752-badc-48b342eeeca2 with identifier: PY80925 to the API
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:13:40Z',
'fuel_type': 'petrol',
'id': '397bec52-4d1e-5752-badc-48b342eeeca2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY80925',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 86963,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-17',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2016}
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80925%27 HTTP/1.1" 200 None
2026-03-30 12:14:30 [auto1.fr] INFO: Saving data for PY80925: {'auction_closing_time': 1774970020.0, 'created_time': 1773254377.340828, 'last_price_update_time': 1774872870.631315}
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY80925') HTTP/1.1" 204 0
2026-03-30 12:14:30 [auto1.fr] INFO: Found listing with ID: WW40675
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.326(s), this was the 1st time calling it.
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.92516676382285 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.092(s), this was the 4th time calling it.
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.272778721435671 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD06652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2026-03-30 12:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE97231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN48177> (referer: https://www.auto1.com/v1/car-details-view/GN48177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with identifier: GN48177
2026-03-30 12:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with scrape type 1
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_5b0e5ecf12372f3599aa60990e11353c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_2a088b137723173d389e37ad6aec7db0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_7afb5891c8a95e26d206ddd162099245.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_8ccfe815d226d2d69e369b87c036963d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_8ccfe815d226d2d69e369b87c036963d.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F5c%252Ff05c4ecbff9b32cedb2bfc7c820b6c6b%252Fpa%252FGN48177_6b3ac45090ce37affb0f541c64adecef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg already downloaded
2026-03-30 12:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac, identifier: GN48177
2026-03-30 12:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with identifier: GN48177
2026-03-30 12:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with identifier: GN48177
2026-03-30 12:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with identifier: GN48177 to the API
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN48177>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.7L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:34:12Z',
'fuel_type': 'diesel',
'id': '8b3da0d2-77e3-5639-b50c-e5651b05b9ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN48177',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Opel',
'model': 'Zafira',
'odometer': 235607,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_8ccfe815d226d2d69e369b87c036963d.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg',
'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_8ccfe815d226d2d69e369b87c036963d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-03-26',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Cosmo Pack',
'transmission': 'manual',
'trim': 'Cosmo Pack',
'year': 2008}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN48177%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.fr] INFO: Saving data for GN48177: {'created_time': 1774872879.839684, 'last_price_update_time': 1774872879.839699, 'auction_closing_time': 1774971252.0}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN48177') HTTP/1.1" 204 0
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.782(s), this was the 2nd time calling it.
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.0592501834109465 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.390(s), this was the 1st time calling it.
2026-03-30 12:14:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.774200793135928 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE64159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ96213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:48 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 15 pages/min), scraped 122 items (at 18 items/min)
2026-03-30 12:14:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC48181> (referer: https://www.auto1.com/v1/car-details-view/CC48181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311a5091-79ad-5ee8-9aad-3c290408f958 with identifier: CC48181
2026-03-30 12:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311a5091-79ad-5ee8-9aad-3c290408f958 with scrape type 1
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_91e528a55c460320843fdde02016cad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_91e528a55c460320843fdde02016cad3.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_2290b90d78fedcab74781cd1f848b4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_2290b90d78fedcab74781cd1f848b4eb.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_b4b921abdf94075ddf5b3f6942874325.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_b4b921abdf94075ddf5b3f6942874325.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_601e1335cb59607717f1597421683c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_601e1335cb59607717f1597421683c0c.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_31490c4a1888903d10c3a38487ef68c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_31490c4a1888903d10c3a38487ef68c4.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg not downloaded yet
2026-03-30 12:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_c2a8605dd3bae42d4ec37da300984c25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_c2a8605dd3bae42d4ec37da300984c25.jpg not downloaded yet
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_630358f18baea50223b48857462acdd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_630358f18baea50223b48857462acdd4.jpg not downloaded yet
2026-03-30 12:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR57312> (referer: https://www.auto1.com/v1/car-details-view/LR57312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb1c780-51e8-5e39-a7d5-6e231240db67 with identifier: LR57312
2026-03-30 12:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb1c780-51e8-5e39-a7d5-6e231240db67 with scrape type 1
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_5333a3a880306f60f5463b077fd16226.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_5333a3a880306f60f5463b077fd16226.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_56d0e92e3b66afed7b892c04441de04a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_56d0e92e3b66afed7b892c04441de04a.jpg not downloaded yet
2026-03-30 12:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_630358f18baea50223b48857462acdd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_0b82bb295c2fb4f82336a46e7999d048.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_0b82bb295c2fb4f82336a46e7999d048.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_4fae40dd88d757c7ccb231e2260702ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_4fae40dd88d757c7ccb231e2260702ec.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_d4740800b85ef3e3dae0696e774b9228.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_d4740800b85ef3e3dae0696e774b9228.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg not downloaded yet
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_ca775c82644bebec1333ea80d55a3226.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_ca775c82644bebec1333ea80d55a3226.jpg not downloaded yet
2026-03-30 12:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b4a90>
2026-03-30 12:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_630358f18baea50223b48857462acdd4.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_630358f18baea50223b48857462acdd4.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg not downloaded yet
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_56d0e92e3b66afed7b892c04441de04a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_ca775c82644bebec1333ea80d55a3226.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1e8b50>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_56d0e92e3b66afed7b892c04441de04a.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_56d0e92e3b66afed7b892c04441de04a.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dc750>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26ea50>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_ca775c82644bebec1333ea80d55a3226.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_ca775c82644bebec1333ea80d55a3226.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0adf490>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_d4740800b85ef3e3dae0696e774b9228.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ee6d0>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_d4740800b85ef3e3dae0696e774b9228.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_d4740800b85ef3e3dae0696e774b9228.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_4fae40dd88d757c7ccb231e2260702ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26e990>
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_4fae40dd88d757c7ccb231e2260702ec.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_4fae40dd88d757c7ccb231e2260702ec.jpg saved to cache
2026-03-30 12:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b5790>
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg saved to cache
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_0b82bb295c2fb4f82336a46e7999d048.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_5333a3a880306f60f5463b077fd16226.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac781d0>
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_0b82bb295c2fb4f82336a46e7999d048.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_0b82bb295c2fb4f82336a46e7999d048.jpg saved to cache
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_c2a8605dd3bae42d4ec37da300984c25.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b6690>
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg saved to cache
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ad610>
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F67%252Fad6755c84bab8e410caf4115827c9be7%252Fpa%252FLR57312_5333a3a880306f60f5463b077fd16226.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_5333a3a880306f60f5463b077fd16226.jpg saved to cache
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeb1c780-51e8-5e39-a7d5-6e231240db67
2026-03-30 12:14:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeb1c780-51e8-5e39-a7d5-6e231240db67, skipping ID generation
2026-03-30 12:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb1c780-51e8-5e39-a7d5-6e231240db67 with scrape type 1
2026-03-30 12:14:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeb1c780-51e8-5e39-a7d5-6e231240db67 sending to next pipeline
2026-03-30 12:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aeb1c780-51e8-5e39-a7d5-6e231240db67, identifier: LR57312
2026-03-30 12:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aeb1c780-51e8-5e39-a7d5-6e231240db67 with identifier: LR57312
2026-03-30 12:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aeb1c780-51e8-5e39-a7d5-6e231240db67 with identifier: LR57312
2026-03-30 12:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aeb1c780-51e8-5e39-a7d5-6e231240db67 with identifier: LR57312 to the API
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_5333a3a880306f60f5463b077fd16226.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:23:19Z',
'fuel_type': 'petrol',
'id': 'aeb1c780-51e8-5e39-a7d5-6e231240db67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR57312',
'listing': 'auction',
'location': 'FR, Saint-Germain-du-Puy',
'make': 'Peugeot',
'model': '2008',
'odometer': 69049,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_5333a3a880306f60f5463b077fd16226.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_b73ce574cd81f80b5a7a6449afb00ce1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_56d0e92e3b66afed7b892c04441de04a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_0b82bb295c2fb4f82336a46e7999d048.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_bc87b9f9880cbe52674ff75ee7c9e535.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_4fae40dd88d757c7ccb231e2260702ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_d4740800b85ef3e3dae0696e774b9228.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_2e293e3cad25fe741de56fcc80c1b5cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_ca775c82644bebec1333ea80d55a3226.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb1c780-51e8-5e39-a7d5-6e231240db67/aeb1c780-51e8-5e39-a7d5-6e231240db67_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/67/ad6755c84bab8e410caf4115827c9be7/pa/LR57312_175f2c54ceaa42fd9e44fb9122818aba.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR57312%27 HTTP/1.1" 200 None
2026-03-30 12:14:55 [auto1.fr] INFO: Saving data for LR57312: {'created_time': 1774872895.750767, 'last_price_update_time': 1774872895.75078, 'auction_closing_time': 1774970599.0}
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LR57312') HTTP/1.1" 204 0
2026-03-30 12:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2de210>
2026-03-30 12:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_c2a8605dd3bae42d4ec37da300984c25.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_c2a8605dd3bae42d4ec37da300984c25.jpg saved to cache
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a1010>
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg saved to cache
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_31490c4a1888903d10c3a38487ef68c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca195fd0>
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_31490c4a1888903d10c3a38487ef68c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_31490c4a1888903d10c3a38487ef68c4.jpg saved to cache
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_601e1335cb59607717f1597421683c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13d550>
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_601e1335cb59607717f1597421683c0c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_601e1335cb59607717f1597421683c0c.jpg saved to cache
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ed0d0>
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg saved to cache
2026-03-30 12:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_b4b921abdf94075ddf5b3f6942874325.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1e9710>
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_b4b921abdf94075ddf5b3f6942874325.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_b4b921abdf94075ddf5b3f6942874325.jpg saved to cache
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_2290b90d78fedcab74781cd1f848b4eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a0c10>
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_2290b90d78fedcab74781cd1f848b4eb.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_2290b90d78fedcab74781cd1f848b4eb.jpg saved to cache
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_91e528a55c460320843fdde02016cad3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0faa610>
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg saved to cache
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2be3d0>
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fdd%252F02dd2f02261dffed4636639ab8863926%252Fpa%252FCC48181_91e528a55c460320843fdde02016cad3.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_91e528a55c460320843fdde02016cad3.jpg saved to cache
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311a5091-79ad-5ee8-9aad-3c290408f958
2026-03-30 12:14:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311a5091-79ad-5ee8-9aad-3c290408f958, skipping ID generation
2026-03-30 12:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311a5091-79ad-5ee8-9aad-3c290408f958 with scrape type 1
2026-03-30 12:14:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311a5091-79ad-5ee8-9aad-3c290408f958 sending to next pipeline
2026-03-30 12:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 311a5091-79ad-5ee8-9aad-3c290408f958, identifier: CC48181
2026-03-30 12:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 311a5091-79ad-5ee8-9aad-3c290408f958 with identifier: CC48181
2026-03-30 12:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 311a5091-79ad-5ee8-9aad-3c290408f958 with identifier: CC48181
2026-03-30 12:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 311a5091-79ad-5ee8-9aad-3c290408f958 with identifier: CC48181 to the API
2026-03-30 12:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_91e528a55c460320843fdde02016cad3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:07:57Z',
'fuel_type': 'diesel',
'id': '311a5091-79ad-5ee8-9aad-3c290408f958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC48181',
'listing': 'auction',
'location': 'FR',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 226172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_91e528a55c460320843fdde02016cad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_e9acbc2a3cad2e58058a8ef2384a3923.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_2290b90d78fedcab74781cd1f848b4eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_b4b921abdf94075ddf5b3f6942874325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_8a08b99fa836e8477b2ddf1e3cfdfbf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_601e1335cb59607717f1597421683c0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_31490c4a1888903d10c3a38487ef68c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_a32b6105c7a6f7f682533e03a2c6733d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_c2a8605dd3bae42d4ec37da300984c25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311a5091-79ad-5ee8-9aad-3c290408f958/311a5091-79ad-5ee8-9aad-3c290408f958_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/dd/02dd2f02261dffed4636639ab8863926/pa/CC48181_630358f18baea50223b48857462acdd4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 12:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC48181%27 HTTP/1.1" 200 None
2026-03-30 12:14:58 [auto1.fr] INFO: Saving data for CC48181: {'created_time': 1774872898.641006, 'last_price_update_time': 1774872898.641017, 'auction_closing_time': 1774969677.0}
2026-03-30 12:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC48181') HTTP/1.1" 204 0
2026-03-30 12:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW05670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH55510> (referer: https://www.auto1.com/v1/car-details-view/CH55510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7 with identifier: CH55510
2026-03-30 12:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7 with scrape type 1
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_70bb54b58d448808dd919abea12a9f2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_70bb54b58d448808dd919abea12a9f2c.jpg already downloaded
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_1d6042fdb52599c5541e415eb6dbc93a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_1d6042fdb52599c5541e415eb6dbc93a.jpg already downloaded
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_4f17b3643b815bb8e3a1130b906bb421.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_4f17b3643b815bb8e3a1130b906bb421.jpg already downloaded
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_f0eabae2f1e14764e70c9d1f8b2f7368.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_f0eabae2f1e14764e70c9d1f8b2f7368.jpg already downloaded
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_23bbd18caaa84bfe433f7f3ea27e0a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_23bbd18caaa84bfe433f7f3ea27e0a5a.jpg already downloaded
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F6f%252F9c6ff713a628b6f2e882e60edcbad1f4%252Fpa%252FCH55510_b2b085b45b9fe885d2537bf016eaeaf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_b2b085b45b9fe885d2537bf016eaeaf0.jpg already downloaded
2026-03-30 12:15:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7, identifier: CH55510
2026-03-30 12:15:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7 with identifier: CH55510
2026-03-30 12:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7 with identifier: CH55510
2026-03-30 12:15:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7 with identifier: CH55510 to the API
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CH55510>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:12:25Z',
'fuel_type': 'diesel',
'id': 'c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH55510',
'listing': 'auction',
'location': "Saint-Barthélemy-d'Anjou",
'make': 'Peugeot',
'model': '5008',
'odometer': 278565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_70bb54b58d448808dd919abea12a9f2c.jpg',
'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_1d6042fdb52599c5541e415eb6dbc93a.jpg',
'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_4f17b3643b815bb8e3a1130b906bb421.jpg',
'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_f0eabae2f1e14764e70c9d1f8b2f7368.jpg',
'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_23bbd18caaa84bfe433f7f3ea27e0a5a.jpg',
'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_b2b085b45b9fe885d2537bf016eaeaf0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_70bb54b58d448808dd919abea12a9f2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_1d6042fdb52599c5541e415eb6dbc93a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_4f17b3643b815bb8e3a1130b906bb421.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_f0eabae2f1e14764e70c9d1f8b2f7368.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_23bbd18caaa84bfe433f7f3ea27e0a5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7/c5d7f1db-a0f8-5d5a-91e7-e5d67473d4c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/6f/9c6ff713a628b6f2e882e60edcbad1f4/pa/CH55510_b2b085b45b9fe885d2537bf016eaeaf0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-25',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 2.0 HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2014}
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH55510%27 HTTP/1.1" 200 None
2026-03-30 12:15:24 [auto1.fr] INFO: Saving data for CH55510: {'created_time': 1774872924.938887, 'last_price_update_time': 1774872924.938897, 'auction_closing_time': 1774969945.0}
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH55510') HTTP/1.1" 204 0
2026-03-30 12:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG71541> (referer: https://www.auto1.com/v1/car-details-view/RG71541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd3d391-90e7-5f55-bdb2-41391f616d46 with identifier: RG71541
2026-03-30 12:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd3d391-90e7-5f55-bdb2-41391f616d46 with scrape type 1
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_059b13a405992c5a46d3c216072c6dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_059b13a405992c5a46d3c216072c6dc4.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_2f4d38216b46364f254b15b6c985ea37.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_2f4d38216b46364f254b15b6c985ea37.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_f233a237b30d25bee9b137b846ba679f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_f233a237b30d25bee9b137b846ba679f.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg not downloaded yet
2026-03-30 12:15:48 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 5 pages/min), scraped 125 items (at 3 items/min)
2026-03-30 12:15:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD06652> (referer: https://www.auto1.com/v1/car-details-view/VD06652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with identifier: VD06652
2026-03-30 12:16:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with scrape type 1
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_98d40944302ca32ae836180feaee41ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_98d40944302ca32ae836180feaee41ab.jpg not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_11fdecc1c79dc62419ce4698bd7e5838.png%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_11fdecc1c79dc62419ce4698bd7e5838.png not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_55467381085d7f6caa67aa3e428caf12.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_55467381085d7f6caa67aa3e428caf12.jpg not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_2287c823697e203f622eba691e85075d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_2287c823697e203f622eba691e85075d.jpg not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_b7563a4a779c112f2445096275f50066.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_b7563a4a779c112f2445096275f50066.jpg not downloaded yet
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_a3701307d96a0e18fb7e1b783b6a02bd.png%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_a3701307d96a0e18fb7e1b783b6a02bd.png not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg not downloaded yet
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_78e5dface3641f4d51f8d066b54c71aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_78e5dface3641f4d51f8d066b54c71aa.jpg not downloaded yet
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_b7563a4a779c112f2445096275f50066.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0adf950>
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg saved to cache
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_78e5dface3641f4d51f8d066b54c71aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca108e50>
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_b7563a4a779c112f2445096275f50066.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_b7563a4a779c112f2445096275f50066.jpg saved to cache
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca10b190>
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_78e5dface3641f4d51f8d066b54c71aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_78e5dface3641f4d51f8d066b54c71aa.jpg saved to cache
2026-03-30 12:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1e8510>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_a3701307d96a0e18fb7e1b783b6a02bd.png> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26ce50>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_7.png HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_2287c823697e203f622eba691e85075d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2aa0d0>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_6.png HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_a3701307d96a0e18fb7e1b783b6a02bd.png') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_a3701307d96a0e18fb7e1b783b6a02bd.png saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc5350>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_2287c823697e203f622eba691e85075d.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_2287c823697e203f622eba691e85075d.jpg saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_55467381085d7f6caa67aa3e428caf12.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_11fdecc1c79dc62419ce4698bd7e5838.png> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e2ed0>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_98d40944302ca32ae836180feaee41ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc9850>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_55467381085d7f6caa67aa3e428caf12.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_55467381085d7f6caa67aa3e428caf12.jpg saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:16:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca296f90>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_1.png HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_11fdecc1c79dc62419ce4698bd7e5838.png') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_11fdecc1c79dc62419ce4698bd7e5838.png saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca19b6d0>
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4cb8572efc0ca5be6d0b83d4ac8fd%252Fpa%252FVD06652_98d40944302ca32ae836180feaee41ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_98d40944302ca32ae836180feaee41ab.jpg saved to cache
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4
2026-03-30 12:16:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8b4be4c-99a0-5395-8bb0-d03d39951dc4, skipping ID generation
2026-03-30 12:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with scrape type 1
2026-03-30 12:16:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b4be4c-99a0-5395-8bb0-d03d39951dc4 sending to next pipeline
2026-03-30 12:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d8b4be4c-99a0-5395-8bb0-d03d39951dc4, identifier: VD06652
2026-03-30 12:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with identifier: VD06652
2026-03-30 12:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with identifier: VD06652
2026-03-30 12:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d8b4be4c-99a0-5395-8bb0-d03d39951dc4 with identifier: VD06652 to the API
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_98d40944302ca32ae836180feaee41ab.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:42:46Z',
'fuel_type': 'petrol',
'id': 'd8b4be4c-99a0-5395-8bb0-d03d39951dc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD06652',
'listing': 'auction',
'location': 'FR, Mitry Mory',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 61279,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_98d40944302ca32ae836180feaee41ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_11fdecc1c79dc62419ce4698bd7e5838.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_55467381085d7f6caa67aa3e428caf12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_0b2f632476ba3f4f3cf4d31a1ac7096a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_2287c823697e203f622eba691e85075d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_b7563a4a779c112f2445096275f50066.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_a3701307d96a0e18fb7e1b783b6a02bd.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_e25da9c6a499f664f5e72f6b2dc5a66f.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_5ddd283b1b0ae8b73c3796292b9bc7bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b4be4c-99a0-5395-8bb0-d03d39951dc4/d8b4be4c-99a0-5395-8bb0-d03d39951dc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4cb8572efc0ca5be6d0b83d4ac8fd/pa/VD06652_78e5dface3641f4d51f8d066b54c71aa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2024}
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD06652%27 HTTP/1.1" 200 None
2026-03-30 12:16:06 [auto1.fr] INFO: Saving data for VD06652: {'created_time': 1774872966.980285, 'last_price_update_time': 1774872966.980296, 'auction_closing_time': 1774971766.0}
2026-03-30 12:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VD06652') HTTP/1.1" 204 0
2026-03-30 12:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_f233a237b30d25bee9b137b846ba679f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0adcd90>
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg saved to cache
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1afc90>
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_f233a237b30d25bee9b137b846ba679f.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_f233a237b30d25bee9b137b846ba679f.jpg saved to cache
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_2f4d38216b46364f254b15b6c985ea37.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b1590>
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg saved to cache
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_059b13a405992c5a46d3c216072c6dc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca103f50>
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_2f4d38216b46364f254b15b6c985ea37.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_2f4d38216b46364f254b15b6c985ea37.jpg saved to cache
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13e850>
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fb9%252F7eb9bc60133fff7217632b19b01c2806%252Fpa%252FRG71541_059b13a405992c5a46d3c216072c6dc4.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_059b13a405992c5a46d3c216072c6dc4.jpg saved to cache
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afd3d391-90e7-5f55-bdb2-41391f616d46
2026-03-30 12:16:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afd3d391-90e7-5f55-bdb2-41391f616d46, skipping ID generation
2026-03-30 12:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd3d391-90e7-5f55-bdb2-41391f616d46 with scrape type 1
2026-03-30 12:16:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afd3d391-90e7-5f55-bdb2-41391f616d46 sending to next pipeline
2026-03-30 12:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: afd3d391-90e7-5f55-bdb2-41391f616d46, identifier: RG71541
2026-03-30 12:16:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: afd3d391-90e7-5f55-bdb2-41391f616d46 with identifier: RG71541
2026-03-30 12:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: afd3d391-90e7-5f55-bdb2-41391f616d46 with identifier: RG71541
2026-03-30 12:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: afd3d391-90e7-5f55-bdb2-41391f616d46 with identifier: RG71541 to the API
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_059b13a405992c5a46d3c216072c6dc4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:39Z',
'fuel_type': 'diesel',
'id': 'afd3d391-90e7-5f55-bdb2-41391f616d46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG71541',
'listing': 'auction',
'location': 'FR, Gouesnou',
'make': 'Citroen',
'model': 'DS4',
'odometer': 267164,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_059b13a405992c5a46d3c216072c6dc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_2f4d38216b46364f254b15b6c985ea37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_09bae641f91c9deec0a0d6c8d2be67a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_f233a237b30d25bee9b137b846ba679f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_6ff61d209b44267c1bbecc2bdb15232b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd3d391-90e7-5f55-bdb2-41391f616d46/afd3d391-90e7-5f55-bdb2-41391f616d46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/b9/7eb9bc60133fff7217632b19b01c2806/pa/RG71541_a1b292ce0ab8d85e8e421dfe30bb5dfc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS4 1.6 HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2011}
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG71541%27 HTTP/1.1" 200 None
2026-03-30 12:16:07 [auto1.fr] INFO: Saving data for RG71541: {'created_time': 1774872967.789853, 'last_price_update_time': 1774872967.789864, 'auction_closing_time': 1774970739.0}
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG71541') HTTP/1.1" 204 0
2026-03-30 12:16:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.402(s), this was the 1st time calling it.
2026-03-30 12:16:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.213291923964439 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE97231> (referer: https://www.auto1.com/v1/car-details-view/DE97231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3 with identifier: DE97231
2026-03-30 12:16:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3 with scrape type 1
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_58bf93814e0afbd221a9cac37939ba09.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_58bf93814e0afbd221a9cac37939ba09.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_d4dbcb6488160709cfc581dbd7b0b5dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_d4dbcb6488160709cfc581dbd7b0b5dd.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_12ed4d5b21caa96f1f8566d2d8de1e72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_12ed4d5b21caa96f1f8566d2d8de1e72.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_722eecccb156409991f75e5fb3b59d6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_722eecccb156409991f75e5fb3b59d6f.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_a8a583e604a6c56e909b3248a5b449f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_a8a583e604a6c56e909b3248a5b449f8.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_ac9f957ce2c5094982944be890875227.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_ac9f957ce2c5094982944be890875227.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_571be50c4f6a2c84803936fa405a800c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_571be50c4f6a2c84803936fa405a800c.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_0b6a7853516743d72584b4dc720f7f71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_0b6a7853516743d72584b4dc720f7f71.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_91c32849d911ae8ada6d13bb7d7f7036.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_91c32849d911ae8ada6d13bb7d7f7036.jpg already downloaded
2026-03-30 12:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F30%252F3f30ba47c5b3c23462b3ff2a0d4b90a4%252Fpa%252FDE97231_321435fc1520da0c84e374a97cb7570a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_321435fc1520da0c84e374a97cb7570a.jpg already downloaded
2026-03-30 12:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3, identifier: DE97231
2026-03-30 12:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3 with identifier: DE97231
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 12:16:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3 with identifier: DE97231
2026-03-30 12:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3 with identifier: DE97231 to the API
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DE97231>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:24:19Z',
'fuel_type': 'petrol',
'id': '8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE97231',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Fiat',
'model': '500X',
'odometer': 122005,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_58bf93814e0afbd221a9cac37939ba09.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_d4dbcb6488160709cfc581dbd7b0b5dd.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_12ed4d5b21caa96f1f8566d2d8de1e72.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_722eecccb156409991f75e5fb3b59d6f.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_a8a583e604a6c56e909b3248a5b449f8.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_ac9f957ce2c5094982944be890875227.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_571be50c4f6a2c84803936fa405a800c.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_0b6a7853516743d72584b4dc720f7f71.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_91c32849d911ae8ada6d13bb7d7f7036.jpg',
'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_321435fc1520da0c84e374a97cb7570a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_58bf93814e0afbd221a9cac37939ba09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_d4dbcb6488160709cfc581dbd7b0b5dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2731135,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_12ed4d5b21caa96f1f8566d2d8de1e72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_722eecccb156409991f75e5fb3b59d6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2868176,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_a8a583e604a6c56e909b3248a5b449f8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_ac9f957ce2c5094982944be890875227.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_571be50c4f6a2c84803936fa405a800c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_0b6a7853516743d72584b4dc720f7f71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3163209,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_91c32849d911ae8ada6d13bb7d7f7036.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3/8a9e88e3-306b-5cee-915d-2fc5ffbf4fb3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/30/3f30ba47c5b3c23462b3ff2a0d4b90a4/pa/DE97231_321435fc1520da0c84e374a97cb7570a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2016}
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE97231%27 HTTP/1.1" 200 None
2026-03-30 12:16:10 [auto1.fr] INFO: Saving data for DE97231: {'created_time': 1774872970.631771, 'last_price_update_time': 1774872970.631783, 'auction_closing_time': 1774970659.0}
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE97231') HTTP/1.1" 204 0
2026-03-30 12:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD39903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX34217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE64159> (referer: https://www.auto1.com/v1/car-details-view/AE64159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c955060-c0df-5c87-84cd-5ccd946bdf6b with identifier: AE64159
2026-03-30 12:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c955060-c0df-5c87-84cd-5ccd946bdf6b with scrape type 1
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3c955060-c0df-5c87-84cd-5ccd946bdf6b
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_fe62c22cbe20d7e3ea0e72a396f35bf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_fe62c22cbe20d7e3ea0e72a396f35bf8.jpg already downloaded
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_1abf804a2f1629e4d445932d668e8f69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_1abf804a2f1629e4d445932d668e8f69.jpg already downloaded
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_76ff0de41b20f1db8fec399873a1d883.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_76ff0de41b20f1db8fec399873a1d883.jpg already downloaded
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_9e70884095bd63efe601fc9fc276f86b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9e70884095bd63efe601fc9fc276f86b.jpg already downloaded
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_9b7788814856787faa3575340547ce60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9b7788814856787faa3575340547ce60.jpg already downloaded
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F33%252Fad3396a3cb010b6247e5ebf00dbcd6d7%252Fpa%252FAE64159_4d47c6fe2b702bf11f5a113937668790.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_4d47c6fe2b702bf11f5a113937668790.jpg already downloaded
2026-03-30 12:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c955060-c0df-5c87-84cd-5ccd946bdf6b, identifier: AE64159
2026-03-30 12:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c955060-c0df-5c87-84cd-5ccd946bdf6b with identifier: AE64159
2026-03-30 12:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c955060-c0df-5c87-84cd-5ccd946bdf6b with identifier: AE64159
2026-03-30 12:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c955060-c0df-5c87-84cd-5ccd946bdf6b with identifier: AE64159 to the API
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE64159>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:54:36Z',
'fuel_type': 'petrol',
'id': '3c955060-c0df-5c87-84cd-5ccd946bdf6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE64159',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Golf III',
'odometer': 244229,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_fe62c22cbe20d7e3ea0e72a396f35bf8.jpg',
'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_1abf804a2f1629e4d445932d668e8f69.jpg',
'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_76ff0de41b20f1db8fec399873a1d883.jpg',
'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9e70884095bd63efe601fc9fc276f86b.jpg',
'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9b7788814856787faa3575340547ce60.jpg',
'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_4d47c6fe2b702bf11f5a113937668790.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_fe62c22cbe20d7e3ea0e72a396f35bf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_1abf804a2f1629e4d445932d668e8f69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_76ff0de41b20f1db8fec399873a1d883.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9e70884095bd63efe601fc9fc276f86b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_9b7788814856787faa3575340547ce60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c955060-c0df-5c87-84cd-5ccd946bdf6b/3c955060-c0df-5c87-84cd-5ccd946bdf6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/33/ad3396a3cb010b6247e5ebf00dbcd6d7/pa/AE64159_4d47c6fe2b702bf11f5a113937668790.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1994-07-11',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Golf III 2.0',
'transmission': 'manual',
'trim': '',
'year': 1994}
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE64159%27 HTTP/1.1" 200 None
2026-03-30 12:16:16 [auto1.fr] INFO: Saving data for AE64159: {'created_time': 1774872976.660881, 'last_price_update_time': 1774872976.660891, 'auction_closing_time': 1774972476.0}
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE64159') HTTP/1.1" 204 0
2026-03-30 12:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP13062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE02752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ96213> (referer: https://www.auto1.com/v1/car-details-view/VJ96213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbece54-3470-57e2-9924-a9589872d28d with identifier: VJ96213
2026-03-30 12:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbece54-3470-57e2-9924-a9589872d28d with scrape type 1
2026-03-30 12:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cbece54-3470-57e2-9924-a9589872d28d
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_a5b4fb42ceeae0b99091ffe3ebf19dc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_a5b4fb42ceeae0b99091ffe3ebf19dc2.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_c9b1f310935751f903a7feae38a3ae46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_c9b1f310935751f903a7feae38a3ae46.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_f7abbf85f14111280002eec54c09b73a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f7abbf85f14111280002eec54c09b73a.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_6c0e088ae363d9cda0739e61d6cf10ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_6c0e088ae363d9cda0739e61d6cf10ff.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_0b7004039388f325a62beb27a0bbc401.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_0b7004039388f325a62beb27a0bbc401.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_14265aea4a33734da623e2fdc06ec102.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_14265aea4a33734da623e2fdc06ec102.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_864364eb47be746e2cc8a651cf3dd82e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_864364eb47be746e2cc8a651cf3dd82e.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_1dd5c41fade474ac98bfcdae0a193e6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_1dd5c41fade474ac98bfcdae0a193e6c.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_f0e592a8d58d3152ebd279a814589982.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f0e592a8d58d3152ebd279a814589982.jpg already downloaded
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fea%252F3eea21991847e90e2d798394d3182a1a%252Fpa%252FVJ96213_43e509c494d41407924555ecea4693b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_43e509c494d41407924555ecea4693b9.jpg already downloaded
2026-03-30 12:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0cbece54-3470-57e2-9924-a9589872d28d, identifier: VJ96213
2026-03-30 12:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0cbece54-3470-57e2-9924-a9589872d28d with identifier: VJ96213
2026-03-30 12:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0cbece54-3470-57e2-9924-a9589872d28d with identifier: VJ96213
2026-03-30 12:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0cbece54-3470-57e2-9924-a9589872d28d with identifier: VJ96213 to the API
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ96213>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:58:00Z',
'fuel_type': 'diesel',
'id': '0cbece54-3470-57e2-9924-a9589872d28d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ96213',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 194105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_a5b4fb42ceeae0b99091ffe3ebf19dc2.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_c9b1f310935751f903a7feae38a3ae46.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f7abbf85f14111280002eec54c09b73a.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_6c0e088ae363d9cda0739e61d6cf10ff.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_0b7004039388f325a62beb27a0bbc401.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_14265aea4a33734da623e2fdc06ec102.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_864364eb47be746e2cc8a651cf3dd82e.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_1dd5c41fade474ac98bfcdae0a193e6c.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f0e592a8d58d3152ebd279a814589982.jpg',
'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_43e509c494d41407924555ecea4693b9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_a5b4fb42ceeae0b99091ffe3ebf19dc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_c9b1f310935751f903a7feae38a3ae46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f7abbf85f14111280002eec54c09b73a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_6c0e088ae363d9cda0739e61d6cf10ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_0b7004039388f325a62beb27a0bbc401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_14265aea4a33734da623e2fdc06ec102.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_864364eb47be746e2cc8a651cf3dd82e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_1dd5c41fade474ac98bfcdae0a193e6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_f0e592a8d58d3152ebd279a814589982.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbece54-3470-57e2-9924-a9589872d28d/0cbece54-3470-57e2-9924-a9589872d28d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ea/3eea21991847e90e2d798394d3182a1a/pa/VJ96213_43e509c494d41407924555ecea4693b9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-03-21',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2016}
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ96213%27 HTTP/1.1" 200 None
2026-03-30 12:16:22 [auto1.fr] INFO: Saving data for VJ96213: {'created_time': 1774872982.611696, 'last_price_update_time': 1774872982.611708, 'auction_closing_time': 1774972680.0}
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ96213') HTTP/1.1" 204 0
2026-03-30 12:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW11385> (referer: https://www.auto1.com/v1/car-details-view/UW11385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 435821b8-463d-5ee5-83bc-0bece7782d32 with identifier: UW11385
2026-03-30 12:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435821b8-463d-5ee5-83bc-0bece7782d32 with scrape type 1
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 435821b8-463d-5ee5-83bc-0bece7782d32
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_aeeb8ec8ee76b732d0ed4106f5ce9353.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_aeeb8ec8ee76b732d0ed4106f5ce9353.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_685155890a483ca35cef8e3dd8c75ab8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_685155890a483ca35cef8e3dd8c75ab8.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_f41128f8eecac2ceab764b4bd8c48f1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_f41128f8eecac2ceab764b4bd8c48f1f.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_9929fafe4a3f74c6a6308ce7007c4c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9929fafe4a3f74c6a6308ce7007c4c96.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_9b747fe7bd06bb36024b386a2e72213f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9b747fe7bd06bb36024b386a2e72213f.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_dc5a1b0121cac79c500b7a68a2432361.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dc5a1b0121cac79c500b7a68a2432361.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_76836a40a30c58fe1d58f44073863073.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_76836a40a30c58fe1d58f44073863073.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_638c652b52c6be738ce9cb12b8b9fdae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_638c652b52c6be738ce9cb12b8b9fdae.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_6be2f585bbc8b1258c3eacaa1114999a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_6be2f585bbc8b1258c3eacaa1114999a.jpg already downloaded
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F67%252F5f67242d6c178dafa0c2fa46cbbfd948%252Fpa%252FUW11385_dcb948ad8094daf365b51d19a9975b7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dcb948ad8094daf365b51d19a9975b7d.jpg already downloaded
2026-03-30 12:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 435821b8-463d-5ee5-83bc-0bece7782d32, identifier: UW11385
2026-03-30 12:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 435821b8-463d-5ee5-83bc-0bece7782d32 with identifier: UW11385
2026-03-30 12:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 435821b8-463d-5ee5-83bc-0bece7782d32 with identifier: UW11385
2026-03-30 12:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 435821b8-463d-5ee5-83bc-0bece7782d32 with identifier: UW11385 to the API
2026-03-30 12:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW11385>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-03-31T15:38:53Z',
'fuel_type': 'diesel',
'id': '435821b8-463d-5ee5-83bc-0bece7782d32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW11385',
'listing': 'auction',
'location': 'FR, CASTELNAU D’ESTRETEFONDS',
'make': 'Audi',
'model': 'A6',
'odometer': 192707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_aeeb8ec8ee76b732d0ed4106f5ce9353.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_685155890a483ca35cef8e3dd8c75ab8.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_f41128f8eecac2ceab764b4bd8c48f1f.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9929fafe4a3f74c6a6308ce7007c4c96.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9b747fe7bd06bb36024b386a2e72213f.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dc5a1b0121cac79c500b7a68a2432361.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_76836a40a30c58fe1d58f44073863073.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_638c652b52c6be738ce9cb12b8b9fdae.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_6be2f585bbc8b1258c3eacaa1114999a.jpg',
'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dcb948ad8094daf365b51d19a9975b7d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3004118,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_aeeb8ec8ee76b732d0ed4106f5ce9353.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_685155890a483ca35cef8e3dd8c75ab8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2811735,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_f41128f8eecac2ceab764b4bd8c48f1f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9929fafe4a3f74c6a6308ce7007c4c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_9b747fe7bd06bb36024b386a2e72213f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dc5a1b0121cac79c500b7a68a2432361.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3151963,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_76836a40a30c58fe1d58f44073863073.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_638c652b52c6be738ce9cb12b8b9fdae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_6be2f585bbc8b1258c3eacaa1114999a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435821b8-463d-5ee5-83bc-0bece7782d32/435821b8-463d-5ee5-83bc-0bece7782d32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/67/5f67242d6c178dafa0c2fa46cbbfd948/pa/UW11385_dcb948ad8094daf365b51d19a9975b7d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW11385%27 HTTP/1.1" 200 None
2026-03-30 12:16:24 [auto1.fr] INFO: Saving data for UW11385: {'created_time': 1774872984.172444, 'last_price_update_time': 1774872984.172454, 'auction_closing_time': 1774971533.0}
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UW11385') HTTP/1.1" 204 0
2026-03-30 12:16:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.756(s), this was the 1st time calling it.
2026-03-30 12:16:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.449020088905049 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD39903> (referer: https://www.auto1.com/v1/car-details-view/KD39903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebf0ed7-3692-58f7-b14f-32811780f7de with identifier: KD39903
2026-03-30 12:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebf0ed7-3692-58f7-b14f-32811780f7de with scrape type 1
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_33899f79f28be8f9b6afad0105ef2659.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_33899f79f28be8f9b6afad0105ef2659.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_864aa6660e885af2f658cd1a3fa54a23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_864aa6660e885af2f658cd1a3fa54a23.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_3fbbf16a13a74f481a7b10d01be16136.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3fbbf16a13a74f481a7b10d01be16136.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c38c1ddf900782587afe9d86daa0d6de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c38c1ddf900782587afe9d86daa0d6de.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_1da5cf31df41249c76ae74daae2941bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_1da5cf31df41249c76ae74daae2941bc.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c1432b06ff5b748031c5e3014e972caa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c1432b06ff5b748031c5e3014e972caa.jpg not downloaded yet
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c3b00a61c4743b23f2cefc2651a28302.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c3b00a61c4743b23f2cefc2651a28302.jpg not downloaded yet
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_33899f79f28be8f9b6afad0105ef2659.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3fbbf16a13a74f481a7b10d01be16136.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0ade890>
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg saved to cache
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16fe50>
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_33899f79f28be8f9b6afad0105ef2659.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_33899f79f28be8f9b6afad0105ef2659.jpg saved to cache
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c1432b06ff5b748031c5e3014e972caa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c38c1ddf900782587afe9d86daa0d6de.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_864aa6660e885af2f658cd1a3fa54a23.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c3b00a61c4743b23f2cefc2651a28302.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca156250>
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg saved to cache
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ce4d0>
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg saved to cache
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca180350>
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_3fbbf16a13a74f481a7b10d01be16136.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3fbbf16a13a74f481a7b10d01be16136.jpg saved to cache
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12d210>
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c1432b06ff5b748031c5e3014e972caa.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c1432b06ff5b748031c5e3014e972caa.jpg saved to cache
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13d790>
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c38c1ddf900782587afe9d86daa0d6de.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c38c1ddf900782587afe9d86daa0d6de.jpg saved to cache
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15e010>
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_864aa6660e885af2f658cd1a3fa54a23.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_864aa6660e885af2f658cd1a3fa54a23.jpg saved to cache
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13ec10>
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_c3b00a61c4743b23f2cefc2651a28302.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c3b00a61c4743b23f2cefc2651a28302.jpg saved to cache
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_1da5cf31df41249c76ae74daae2941bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd01cc2d0>
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Feb%252F74eb1fd558027391fc7f81f5749e5903%252Fpa%252FKD39903_1da5cf31df41249c76ae74daae2941bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_1da5cf31df41249c76ae74daae2941bc.jpg saved to cache
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ebf0ed7-3692-58f7-b14f-32811780f7de
2026-03-30 12:16:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ebf0ed7-3692-58f7-b14f-32811780f7de, skipping ID generation
2026-03-30 12:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebf0ed7-3692-58f7-b14f-32811780f7de with scrape type 1
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ebf0ed7-3692-58f7-b14f-32811780f7de sending to next pipeline
2026-03-30 12:16:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ebf0ed7-3692-58f7-b14f-32811780f7de, identifier: KD39903
2026-03-30 12:16:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ebf0ed7-3692-58f7-b14f-32811780f7de with identifier: KD39903
2026-03-30 12:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ebf0ed7-3692-58f7-b14f-32811780f7de with identifier: KD39903
2026-03-30 12:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1ebf0ed7-3692-58f7-b14f-32811780f7de with identifier: KD39903 to the API
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_1da5cf31df41249c76ae74daae2941bc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:52Z',
'fuel_type': 'diesel',
'id': '1ebf0ed7-3692-58f7-b14f-32811780f7de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD39903',
'listing': 'auction',
'location': 'FR, Boulogne-Billancourt',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 117204,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2630503,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_80f52ece9ead10ad7425997fdcbba6c2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_33899f79f28be8f9b6afad0105ef2659.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3f06aa03fb7ec6b5278d6be36e4a6a82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_ba2291a92c0172a9eb597e56c996fd1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_864aa6660e885af2f658cd1a3fa54a23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_3fbbf16a13a74f481a7b10d01be16136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c38c1ddf900782587afe9d86daa0d6de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2631384,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_1da5cf31df41249c76ae74daae2941bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c1432b06ff5b748031c5e3014e972caa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebf0ed7-3692-58f7-b14f-32811780f7de/1ebf0ed7-3692-58f7-b14f-32811780f7de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/eb/74eb1fd558027391fc7f81f5749e5903/pa/KD39903_c3b00a61c4743b23f2cefc2651a28302.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2010}
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD39903%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Saving data for KD39903: {'created_time': 1774872998.001119, 'last_price_update_time': 1774872998.00113, 'auction_closing_time': 1774969732.0}
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD39903') HTTP/1.1" 204 0
2026-03-30 12:16:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.059(s), this was the 2nd time calling it.
2026-03-30 12:16:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.56911804383727 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX34217> (referer: https://www.auto1.com/v1/car-details-view/VX34217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0332c1c1-181d-5479-bdeb-2a1617d6de2a with identifier: VX34217
2026-03-30 12:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a with scrape type 1
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_ca09fd201183a215d67f586972e14a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_ca09fd201183a215d67f586972e14a62.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_250337bdc74ad1561821aedffc9a8c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_250337bdc74ad1561821aedffc9a8c21.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_3952a7251589ddc3734777268436708e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_3952a7251589ddc3734777268436708e.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg not downloaded yet
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_ca09fd201183a215d67f586972e14a62.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_af625269df8d1cb6af124cae3923a5d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_af625269df8d1cb6af124cae3923a5d5.jpg not downloaded yet
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_250337bdc74ad1561821aedffc9a8c21.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_3952a7251589ddc3734777268436708e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_5420133cc761007dc3119b08cedbede7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5420133cc761007dc3119b08cedbede7.jpg not downloaded yet
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg not downloaded yet
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd01cc590>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca262fd0>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_ca09fd201183a215d67f586972e14a62.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_ca09fd201183a215d67f586972e14a62.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5420133cc761007dc3119b08cedbede7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_af625269df8d1cb6af124cae3923a5d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b2c110>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_250337bdc74ad1561821aedffc9a8c21.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_250337bdc74ad1561821aedffc9a8c21.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac64410>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_3952a7251589ddc3734777268436708e.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_3952a7251589ddc3734777268436708e.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab22290>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12f690>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab49d50>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_5420133cc761007dc3119b08cedbede7.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5420133cc761007dc3119b08cedbede7.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26db50>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_af625269df8d1cb6af124cae3923a5d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_af625269df8d1cb6af124cae3923a5d5.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac7afd0>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2fb650>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fad%252Fe2ad24412ef6bb547c8ec28c393a166f%252Fpa%252FVX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a
2026-03-30 12:16:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0332c1c1-181d-5479-bdeb-2a1617d6de2a, skipping ID generation
2026-03-30 12:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a with scrape type 1
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0332c1c1-181d-5479-bdeb-2a1617d6de2a sending to next pipeline
2026-03-30 12:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0332c1c1-181d-5479-bdeb-2a1617d6de2a, identifier: VX34217
2026-03-30 12:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0332c1c1-181d-5479-bdeb-2a1617d6de2a with identifier: VX34217
2026-03-30 12:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0332c1c1-181d-5479-bdeb-2a1617d6de2a with identifier: VX34217
2026-03-30 12:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0332c1c1-181d-5479-bdeb-2a1617d6de2a with identifier: VX34217 to the API
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:02:44Z',
'fuel_type': 'petrol',
'id': '0332c1c1-181d-5479-bdeb-2a1617d6de2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX34217',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Citroen',
'model': 'C1',
'odometer': 148174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_ca09fd201183a215d67f586972e14a62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_2de706674ce8cc6456bc871bee9c6aa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_250337bdc74ad1561821aedffc9a8c21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_3952a7251589ddc3734777268436708e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_8df7b1c377aba7e8c33fb19e65f439d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5569c7c15cc34906ca7bbd1ea818a952.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_178f2e395c5ee453e6a32d56c6d7d192.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_af625269df8d1cb6af124cae3923a5d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_5420133cc761007dc3119b08cedbede7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0332c1c1-181d-5479-bdeb-2a1617d6de2a/0332c1c1-181d-5479-bdeb-2a1617d6de2a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ad/e2ad24412ef6bb547c8ec28c393a166f/pa/VX34217_bf1c9eb4eddbc0c54bce3c64174898e9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-27',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2012}
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX34217%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [auto1.fr] INFO: Saving data for VX34217: {'created_time': 1774873004.501739, 'last_price_update_time': 1774873004.501749, 'auction_closing_time': 1774969364.0}
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX34217') HTTP/1.1" 204 0
2026-03-30 12:16:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:16:48 [scrapy.extensions.logstats] INFO: Crawled 163 pages (at 11 pages/min), scraped 133 items (at 8 items/min)
2026-03-30 12:16:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.701(s), this was the 1st time calling it.
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.952108220899848 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP13062> (referer: https://www.auto1.com/v1/car-details-view/EP13062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b198028f-7ee1-53b6-8816-afdb539279d4 with identifier: EP13062
2026-03-30 12:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b198028f-7ee1-53b6-8816-afdb539279d4 with scrape type 1
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_e7b515945f10fc3ef63387752d92c35c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_e7b515945f10fc3ef63387752d92c35c.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_2570f4ab3abb087661c20af14423a975.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_2570f4ab3abb087661c20af14423a975.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_46f5c43d264c85f1ed739196b166b558.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_46f5c43d264c85f1ed739196b166b558.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_c5b1fc90847d06f830892f135485b136.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c5b1fc90847d06f830892f135485b136.jpg not downloaded yet
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_e7b515945f10fc3ef63387752d92c35c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg not downloaded yet
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_2570f4ab3abb087661c20af14423a975.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_c6ed70de7963c440636076e2bfca69c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c6ed70de7963c440636076e2bfca69c3.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_624cd18a6a24b82b313a166a4928cfe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_624cd18a6a24b82b313a166a4928cfe3.jpg not downloaded yet
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca261910>
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_e7b515945f10fc3ef63387752d92c35c.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_e7b515945f10fc3ef63387752d92c35c.jpg saved to cache
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e6f50>
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg saved to cache
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc3b90>
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_2570f4ab3abb087661c20af14423a975.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_2570f4ab3abb087661c20af14423a975.jpg saved to cache
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c5b1fc90847d06f830892f135485b136.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_46f5c43d264c85f1ed739196b166b558.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc3050>
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c6ed70de7963c440636076e2bfca69c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12e290>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_624cd18a6a24b82b313a166a4928cfe3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f8110>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca235250>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_c5b1fc90847d06f830892f135485b136.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c5b1fc90847d06f830892f135485b136.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b43c10>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_46f5c43d264c85f1ed739196b166b558.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_46f5c43d264c85f1ed739196b166b558.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9a550>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_c6ed70de7963c440636076e2bfca69c3.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c6ed70de7963c440636076e2bfca69c3.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca250710>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F59%252F1959292ccfc3e3e93af61eb5b8cae439%252Fpa%252FEP13062_624cd18a6a24b82b313a166a4928cfe3.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_624cd18a6a24b82b313a166a4928cfe3.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b198028f-7ee1-53b6-8816-afdb539279d4
2026-03-30 12:16:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b198028f-7ee1-53b6-8816-afdb539279d4, skipping ID generation
2026-03-30 12:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b198028f-7ee1-53b6-8816-afdb539279d4 with scrape type 1
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b198028f-7ee1-53b6-8816-afdb539279d4 sending to next pipeline
2026-03-30 12:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b198028f-7ee1-53b6-8816-afdb539279d4, identifier: EP13062
2026-03-30 12:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b198028f-7ee1-53b6-8816-afdb539279d4 with identifier: EP13062
2026-03-30 12:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b198028f-7ee1-53b6-8816-afdb539279d4 with identifier: EP13062
2026-03-30 12:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b198028f-7ee1-53b6-8816-afdb539279d4 with identifier: EP13062 to the API
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_624cd18a6a24b82b313a166a4928cfe3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 236,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:37:30Z',
'fuel_type': 'diesel',
'id': 'b198028f-7ee1-53b6-8816-afdb539279d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP13062',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 82299,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_e7b515945f10fc3ef63387752d92c35c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_f28c8e16918f3ba47427435ba9cfbe8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_2570f4ab3abb087661c20af14423a975.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_6c4a1ee99e034b0755969a1a3c01ec92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_46f5c43d264c85f1ed739196b166b558.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c5b1fc90847d06f830892f135485b136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_bb2238fa67e2aa3ba07cd406a7e5a5b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_83bb4057fb6592cfb5d9da1079dfd08a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_c6ed70de7963c440636076e2bfca69c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b198028f-7ee1-53b6-8816-afdb539279d4/b198028f-7ee1-53b6-8816-afdb539279d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/59/1959292ccfc3e3e93af61eb5b8cae439/pa/EP13062_624cd18a6a24b82b313a166a4928cfe3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-25',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
'transmission': 'manual',
'trim': '33 L2H2 Club Start&Stop',
'year': 2022}
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP13062%27 HTTP/1.1" 200 None
2026-03-30 12:16:51 [auto1.fr] INFO: Saving data for EP13062: {'created_time': 1774873011.753878, 'last_price_update_time': 1774873011.753891, 'auction_closing_time': 1774971450.0}
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP13062') HTTP/1.1" 204 0
2026-03-30 12:16:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.720(s), this was the 1st time calling it.
2026-03-30 12:16:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.443061961788955 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:17:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC60343> (referer: https://www.auto1.com/v1/car-details-view/UC60343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deb7fd15-d3f0-508e-ad3e-59ab891c85be with identifier: UC60343
2026-03-30 12:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deb7fd15-d3f0-508e-ad3e-59ab891c85be with scrape type 1
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item deb7fd15-d3f0-508e-ad3e-59ab891c85be
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_61f0b7d56eb767c0a5958f76aff1756d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_61f0b7d56eb767c0a5958f76aff1756d.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_272cb200bdee09243c5b714ae4da3251.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_272cb200bdee09243c5b714ae4da3251.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_4cb83e13f4971730e1448ee9b1b40958.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4cb83e13f4971730e1448ee9b1b40958.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_734f331f98e2f99b33d4127a757bf514.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_734f331f98e2f99b33d4127a757bf514.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_dff59b3f65d5a981c5e140bee743cf5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_dff59b3f65d5a981c5e140bee743cf5e.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_0147035c65deffed37c6f96f6140a351.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_0147035c65deffed37c6f96f6140a351.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_4c548d1f2c6b9f8bb54b8b76cca1693a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4c548d1f2c6b9f8bb54b8b76cca1693a.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_145dde0a6a0a59ae112ffc8775c49f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_145dde0a6a0a59ae112ffc8775c49f61.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_f74da5f30b185e6cd984c6af45560716.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_f74da5f30b185e6cd984c6af45560716.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fae%252F0bae732c3a2e8e313550be6166226711%252Fpa%252FUC60343_bce89ae45e14bc44f8312a1553662041.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_bce89ae45e14bc44f8312a1553662041.jpg already downloaded
2026-03-30 12:17:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: deb7fd15-d3f0-508e-ad3e-59ab891c85be, identifier: UC60343
2026-03-30 12:17:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: deb7fd15-d3f0-508e-ad3e-59ab891c85be with identifier: UC60343
2026-03-30 12:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: deb7fd15-d3f0-508e-ad3e-59ab891c85be with identifier: UC60343
2026-03-30 12:17:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: deb7fd15-d3f0-508e-ad3e-59ab891c85be with identifier: UC60343 to the API
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC60343>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:11:39Z',
'fuel_type': 'diesel',
'id': 'deb7fd15-d3f0-508e-ad3e-59ab891c85be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC60343',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Audi',
'model': 'Q5',
'odometer': 204663,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_61f0b7d56eb767c0a5958f76aff1756d.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_272cb200bdee09243c5b714ae4da3251.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4cb83e13f4971730e1448ee9b1b40958.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_734f331f98e2f99b33d4127a757bf514.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_dff59b3f65d5a981c5e140bee743cf5e.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_0147035c65deffed37c6f96f6140a351.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4c548d1f2c6b9f8bb54b8b76cca1693a.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_145dde0a6a0a59ae112ffc8775c49f61.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_f74da5f30b185e6cd984c6af45560716.jpg',
'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_bce89ae45e14bc44f8312a1553662041.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_61f0b7d56eb767c0a5958f76aff1756d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_272cb200bdee09243c5b714ae4da3251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4cb83e13f4971730e1448ee9b1b40958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_734f331f98e2f99b33d4127a757bf514.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_dff59b3f65d5a981c5e140bee743cf5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_0147035c65deffed37c6f96f6140a351.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_4c548d1f2c6b9f8bb54b8b76cca1693a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_145dde0a6a0a59ae112ffc8775c49f61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_f74da5f30b185e6cd984c6af45560716.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb7fd15-d3f0-508e-ad3e-59ab891c85be/deb7fd15-d3f0-508e-ad3e-59ab891c85be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/ae/0bae732c3a2e8e313550be6166226711/pa/UC60343_bce89ae45e14bc44f8312a1553662041.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro S Line',
'transmission': 'manual',
'trim': 'quattro S Line',
'year': 2014}
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC60343%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [auto1.fr] INFO: Saving data for UC60343: {'created_time': 1774873027.311405, 'last_price_update_time': 1774873027.311417, 'auction_closing_time': 1774969899.0}
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC60343') HTTP/1.1" 204 0
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE02752> (referer: https://www.auto1.com/v1/car-details-view/VE02752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18eb743b-3391-5381-b4e3-8243fef0b842 with identifier: VE02752
2026-03-30 12:17:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18eb743b-3391-5381-b4e3-8243fef0b842 with scrape type 1
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_54e7a7a0773c030194412a63da224446.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_54e7a7a0773c030194412a63da224446.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_20485cc9377cd4193f739b66f6549f36.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_20485cc9377cd4193f739b66f6549f36.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_70c591aa4887867e7edd6191b6e357f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_70c591aa4887867e7edd6191b6e357f4.jpg not downloaded yet
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_ff4936113dbf44eb736754bb34b8716d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_ff4936113dbf44eb736754bb34b8716d.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_368bcb16df60f6e032d0efb4493db3b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_368bcb16df60f6e032d0efb4493db3b6.jpg not downloaded yet
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_20485cc9377cd4193f739b66f6549f36.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_1a823307c9a566c14a9a200dde443562.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_1a823307c9a566c14a9a200dde443562.jpg not downloaded yet
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_19bb92254955c6fcf8b46753faf9171b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_19bb92254955c6fcf8b46753faf9171b.jpg not downloaded yet
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_70c591aa4887867e7edd6191b6e357f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_368bcb16df60f6e032d0efb4493db3b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc3990>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg saved to cache
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_ff4936113dbf44eb736754bb34b8716d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_54e7a7a0773c030194412a63da224446.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_1a823307c9a566c14a9a200dde443562.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dca690>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_20485cc9377cd4193f739b66f6549f36.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_20485cc9377cd4193f739b66f6549f36.jpg saved to cache
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9a4d0>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg saved to cache
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cf490>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_70c591aa4887867e7edd6191b6e357f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_70c591aa4887867e7edd6191b6e357f4.jpg saved to cache
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b30d0>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_368bcb16df60f6e032d0efb4493db3b6.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_368bcb16df60f6e032d0efb4493db3b6.jpg saved to cache
2026-03-30 12:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_19bb92254955c6fcf8b46753faf9171b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922b590>
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_ff4936113dbf44eb736754bb34b8716d.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_ff4936113dbf44eb736754bb34b8716d.jpg saved to cache
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b43850>
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_54e7a7a0773c030194412a63da224446.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_54e7a7a0773c030194412a63da224446.jpg saved to cache
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca181290>
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg saved to cache
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1973d0>
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_1a823307c9a566c14a9a200dde443562.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_1a823307c9a566c14a9a200dde443562.jpg saved to cache
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca180c10>
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5b%252F9c5bed41a0f6a09d4f1bf18d44aae60a%252Fpa%252FVE02752_19bb92254955c6fcf8b46753faf9171b.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_19bb92254955c6fcf8b46753faf9171b.jpg saved to cache
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18eb743b-3391-5381-b4e3-8243fef0b842
2026-03-30 12:17:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18eb743b-3391-5381-b4e3-8243fef0b842, skipping ID generation
2026-03-30 12:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18eb743b-3391-5381-b4e3-8243fef0b842 with scrape type 1
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18eb743b-3391-5381-b4e3-8243fef0b842 sending to next pipeline
2026-03-30 12:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 18eb743b-3391-5381-b4e3-8243fef0b842, identifier: VE02752
2026-03-30 12:17:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 18eb743b-3391-5381-b4e3-8243fef0b842 with identifier: VE02752
2026-03-30 12:17:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 18eb743b-3391-5381-b4e3-8243fef0b842 with identifier: VE02752
2026-03-30 12:17:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 18eb743b-3391-5381-b4e3-8243fef0b842 with identifier: VE02752 to the API
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_19bb92254955c6fcf8b46753faf9171b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:11:40Z',
'fuel_type': 'petrol',
'id': '18eb743b-3391-5381-b4e3-8243fef0b842',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE02752',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Peugeot',
'model': '208',
'odometer': 104579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_f7b24c6291d48b3ebd5d35b4d203fd74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_54e7a7a0773c030194412a63da224446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_20485cc9377cd4193f739b66f6549f36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_5ee2f094c37bcbb6f99a0c9bdb8c94ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_b9cc6663ea3800ac88ba5772c9673ee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_70c591aa4887867e7edd6191b6e357f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_ff4936113dbf44eb736754bb34b8716d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_368bcb16df60f6e032d0efb4493db3b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_1a823307c9a566c14a9a200dde443562.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18eb743b-3391-5381-b4e3-8243fef0b842/18eb743b-3391-5381-b4e3-8243fef0b842_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/5b/9c5bed41a0f6a09d4f1bf18d44aae60a/pa/VE02752_19bb92254955c6fcf8b46753faf9171b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Féline',
'transmission': 'automatic',
'trim': 'Féline',
'year': 2016}
2026-03-30 12:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE02752%27 HTTP/1.1" 200 None
2026-03-30 12:17:09 [auto1.fr] INFO: Saving data for VE02752: {'created_time': 1774873029.098388, 'last_price_update_time': 1774873029.098405, 'auction_closing_time': 1774969900.0}
2026-03-30 12:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE02752') HTTP/1.1" 204 0
2026-03-30 12:17:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.416(s), this was the 1st time calling it.
2026-03-30 12:17:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.658454941461175 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:17:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW77264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:48 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 4 pages/min), scraped 136 items (at 3 items/min)
2026-03-30 12:17:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:18:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.319(s), this was the 1st time calling it.
2026-03-30 12:18:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.909185087175451 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.166(s), this was the 1st time calling it.
2026-03-30 12:18:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.234056909360715 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:48 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 0 pages/min), scraped 136 items (at 0 items/min)
2026-03-30 12:18:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.924(s), this was the 2nd time calling it.
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.22133890225695 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:18:55 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 5737 | hits on page: 40
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: GZ25721
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ25721%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for GZ25721: 0
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: JU04159
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: ES16654
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: DE58917
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: PY17725
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY17725%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for PY17725: 0
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: NW77264
2026-03-30 12:18:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: SG94624
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: CL78536
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: YF33503
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: GF84131
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF84131%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for GF84131: 0
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: EZ54447
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: PY80925
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80925%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for PY80925: 0
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: WW40675
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: DK33853
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: UL02558
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: WB66153
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: NF20338
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: NL19951
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL19951%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for NL19951: 1
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: HY90819
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: MB48414
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: AB78144
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: RX71466
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX71466%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for RX71466: 1
2026-03-30 12:18:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:55 [auto1.fr] INFO: Found listing with ID: ZC78269
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC78269%27 HTTP/1.1" 200 None
2026-03-30 12:18:55 [auto1.fr] INFO: Scrape type for ZC78269: 2
2026-03-30 12:18:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506b1103-8a68-592d-9b26-b5ad0414f285 with identifier: ZC78269
2026-03-30 12:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506b1103-8a68-592d-9b26-b5ad0414f285 with scrape type 2
2026-03-30 12:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 506b1103-8a68-592d-9b26-b5ad0414f285 with scrape type 2
2026-03-30 12:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 506b1103-8a68-592d-9b26-b5ad0414f285, identifier: ZC78269
2026-03-30 12:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 506b1103-8a68-592d-9b26-b5ad0414f285 with identifier: ZC78269
2026-03-30 12:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 506b1103-8a68-592d-9b26-b5ad0414f285 with identifier: ZC78269
2026-03-30 12:18:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 506b1103-8a68-592d-9b26-b5ad0414f285 with identifier: ZC78269 to the API
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:18:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 71,
'expiration_date': '2026-03-31T15:19:32Z',
'fuel_type': 'petrol',
'id': '506b1103-8a68-592d-9b26-b5ad0414f285',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC78269',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 88716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-18',
'seller_name': None,
'title': 'Ford Fiesta 1.1 Business NAV',
'transmission': 'manual',
'trim': 'Business NAV',
'year': 2019}
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC78269%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [auto1.fr] INFO: Saving data for ZC78269: {'auction_closing_time': 1774970372.0, 'created_time': 1772608425.044761, 'last_price_update_time': 1774873136.363982}
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC78269') HTTP/1.1" 204 0
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: PE80694
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: RS22813
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: RK79359
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: UT77845
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: PK45621
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: AC65647
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: RG17064
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: UA69739
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: KW43431
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: KN07283
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: GT72256
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: MH50218
2026-03-30 12:18:56 [auto1.fr] INFO: Found listing with ID: YJ92364
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.275(s), this was the 3rd time calling it.
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.3331906372674585 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU73634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:04 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 5737 | hits on page: 40
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: EY29396
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: VN71895
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: FX07138
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: HW58466
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: MD91591
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: XA31897
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: XL96735
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL96735%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for XL96735: 1
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: FG22650
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: JA21075
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: JV74591
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV74591%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for JV74591: 1
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: SD17416
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: CZ33179
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ33179%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for CZ33179: 2
2026-03-30 12:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2064acf-1ef9-539a-9989-8600cd308a9b with identifier: CZ33179
2026-03-30 12:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2064acf-1ef9-539a-9989-8600cd308a9b with scrape type 2
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2064acf-1ef9-539a-9989-8600cd308a9b with scrape type 2
2026-03-30 12:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2064acf-1ef9-539a-9989-8600cd308a9b, identifier: CZ33179
2026-03-30 12:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2064acf-1ef9-539a-9989-8600cd308a9b with identifier: CZ33179
2026-03-30 12:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2064acf-1ef9-539a-9989-8600cd308a9b with identifier: CZ33179
2026-03-30 12:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2064acf-1ef9-539a-9989-8600cd308a9b with identifier: CZ33179 to the API
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:36:28Z',
'fuel_type': 'diesel',
'id': 'a2064acf-1ef9-539a-9989-8600cd308a9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ33179',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 231569,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-03',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Connect Edition',
'transmission': 'manual',
'trim': 'Connect Edition',
'year': 2013}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ33179%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Saving data for CZ33179: {'auction_closing_time': 1774971388.0, 'created_time': 1772950289.154717, 'last_price_update_time': 1774873144.732781}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ33179') HTTP/1.1" 204 0
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: XB50119
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: WU92358
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: BD23693
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD23693%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for BD23693: 1
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.910(s), this was the 2nd time calling it.
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.429542542306581 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: PH25199
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: JJ00045
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: GH15305
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: ZV76946
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: PY79941
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY79941%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for PY79941: 1
2026-03-30 12:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL19951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: KH65686
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: FG40566
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: MC27609
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: WP31416
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: YH69982
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH69982%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for YH69982: 1
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: YN92407
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: GC01240
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: VF41194
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: DB59930
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: AB15378
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: VV69981
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: TK36036
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: BM86570
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: BX30408
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: FR75409
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: EJ56580
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: YJ70488
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ70488%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for YJ70488: 1
2026-03-30 12:19:04 [auto1.fr] INFO: Found listing with ID: SS19249
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS19249%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Scrape type for SS19249: 2
2026-03-30 12:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8f1accb-1f99-5849-bbff-f11ed826be72 with identifier: SS19249
2026-03-30 12:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8f1accb-1f99-5849-bbff-f11ed826be72 with scrape type 2
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8f1accb-1f99-5849-bbff-f11ed826be72 with scrape type 2
2026-03-30 12:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8f1accb-1f99-5849-bbff-f11ed826be72, identifier: SS19249
2026-03-30 12:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8f1accb-1f99-5849-bbff-f11ed826be72 with identifier: SS19249
2026-03-30 12:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8f1accb-1f99-5849-bbff-f11ed826be72 with identifier: SS19249
2026-03-30 12:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8f1accb-1f99-5849-bbff-f11ed826be72 with identifier: SS19249 to the API
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:56:37Z',
'fuel_type': 'petrol',
'id': 'b8f1accb-1f99-5849-bbff-f11ed826be72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS19249',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 56380,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS19249%27 HTTP/1.1" 200 None
2026-03-30 12:19:05 [auto1.fr] INFO: Saving data for SS19249: {'auction_closing_time': 1774972597.0, 'created_time': 1773693391.74072, 'last_price_update_time': 1774873145.375889}
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS19249') HTTP/1.1" 204 0
2026-03-30 12:19:05 [auto1.fr] INFO: Found listing with ID: ST02025
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST02025%27 HTTP/1.1" 200 None
2026-03-30 12:19:05 [auto1.fr] INFO: Scrape type for ST02025: 1
2026-03-30 12:19:05 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 12:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL96735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU73634> (referer: https://www.auto1.com/v1/car-details-view/WU73634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23adfa2-5d40-5d31-b1d3-84455b680031 with identifier: WU73634
2026-03-30 12:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23adfa2-5d40-5d31-b1d3-84455b680031 with scrape type 1
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg not downloaded yet
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_cfefb3d1947f57219b50f0f2966cc320.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_cfefb3d1947f57219b50f0f2966cc320.jpg not downloaded yet
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg not downloaded yet
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg not downloaded yet
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_a713a3f53067a9ff4be222316e32aee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_a713a3f53067a9ff4be222316e32aee0.jpg not downloaded yet
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg not downloaded yet
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD12219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_cfefb3d1947f57219b50f0f2966cc320.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922e550>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac66090>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_cfefb3d1947f57219b50f0f2966cc320.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_cfefb3d1947f57219b50f0f2966cc320.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac77690>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2cc390>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d7890>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_a713a3f53067a9ff4be222316e32aee0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2417d0>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F82%252Fd682ae3e909522e7cc14b0d8a655d75e%252Fpa%252FWU73634_a713a3f53067a9ff4be222316e32aee0.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_a713a3f53067a9ff4be222316e32aee0.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e23adfa2-5d40-5d31-b1d3-84455b680031
2026-03-30 12:19:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e23adfa2-5d40-5d31-b1d3-84455b680031, skipping ID generation
2026-03-30 12:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23adfa2-5d40-5d31-b1d3-84455b680031 with scrape type 1
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e23adfa2-5d40-5d31-b1d3-84455b680031 sending to next pipeline
2026-03-30 12:19:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e23adfa2-5d40-5d31-b1d3-84455b680031, identifier: WU73634
2026-03-30 12:19:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e23adfa2-5d40-5d31-b1d3-84455b680031 with identifier: WU73634
2026-03-30 12:19:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e23adfa2-5d40-5d31-b1d3-84455b680031 with identifier: WU73634
2026-03-30 12:19:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e23adfa2-5d40-5d31-b1d3-84455b680031 with identifier: WU73634 to the API
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_a713a3f53067a9ff4be222316e32aee0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 230,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.7L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:10:39Z',
'fuel_type': 'diesel',
'id': 'e23adfa2-5d40-5d31-b1d3-84455b680031',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU73634',
'listing': 'auction',
'location': 'FR, Herblay',
'make': 'Citroen',
'model': 'C6',
'odometer': 168060,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8d2aea4cf16dcd385bc9dc80b51b6bc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_cfefb3d1947f57219b50f0f2966cc320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_f3cfe26a6193ec6c6b1c6172479f0669.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_950e2f0f5fde096774b4c7074d6d55f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_a713a3f53067a9ff4be222316e32aee0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23adfa2-5d40-5d31-b1d3-84455b680031/e23adfa2-5d40-5d31-b1d3-84455b680031_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/82/d682ae3e909522e7cc14b0d8a655d75e/pa/WU73634_8b04f1be2236d71b6d2cffc6c55ffc45.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-04-22',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C6 2.7 V6 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2008}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU73634%27 HTTP/1.1" 200 None
2026-03-30 12:19:20 [auto1.fr] INFO: Saving data for WU73634: {'created_time': 1774873160.525665, 'last_price_update_time': 1774873160.525678, 'auction_closing_time': 1774969839.0}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU73634') HTTP/1.1" 204 0
2026-03-30 12:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:21 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 5738 | hits on page: 40
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: RX64079
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: PT96039
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: MG58458
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG58458%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.fr] INFO: Scrape type for MG58458: 1
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: JG14972
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: WB68155
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: AX54768
2026-03-30 12:19:21 [auto1.fr] INFO: Found listing with ID: VT05411
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT05411%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.fr] INFO: Scrape type for VT05411: 2
2026-03-30 12:19:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e155aa2-6f8a-5452-94eb-98217ed6f303 with identifier: VT05411
2026-03-30 12:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e155aa2-6f8a-5452-94eb-98217ed6f303 with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e155aa2-6f8a-5452-94eb-98217ed6f303 with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e155aa2-6f8a-5452-94eb-98217ed6f303, identifier: VT05411
2026-03-30 12:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e155aa2-6f8a-5452-94eb-98217ed6f303 with identifier: VT05411
2026-03-30 12:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e155aa2-6f8a-5452-94eb-98217ed6f303 with identifier: VT05411
2026-03-30 12:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e155aa2-6f8a-5452-94eb-98217ed6f303 with identifier: VT05411 to the API
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:43:16Z',
'fuel_type': 'petrol',
'id': '3e155aa2-6f8a-5452-94eb-98217ed6f303',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT05411',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 105557,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-11',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pure',
'year': 2012}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT05411%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Saving data for VT05411: {'auction_closing_time': 1774971796.0, 'created_time': 1774091828.181076, 'last_price_update_time': 1774873162.050305}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VT05411') HTTP/1.1" 204 0
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: YV32502
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: JA45555
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: FY62373
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: GE73125
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE73125%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Scrape type for GE73125: 1
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: BC58235
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: XV47033
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: NP19915
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: PH75787
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: AF42565
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: VV35925
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: LC59253
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: NE46775
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE46775%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Scrape type for NE46775: 2
2026-03-30 12:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with identifier: NE46775
2026-03-30 12:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 295c7de5-af37-53c9-a9aa-ea7ebc1746f6, identifier: NE46775
2026-03-30 12:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with identifier: NE46775
2026-03-30 12:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with identifier: NE46775
2026-03-30 12:19:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 295c7de5-af37-53c9-a9aa-ea7ebc1746f6 with identifier: NE46775 to the API
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:39:48Z',
'fuel_type': 'diesel',
'id': '295c7de5-af37-53c9-a9aa-ea7ebc1746f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE46775',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 161093,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-02',
'seller_name': None,
'title': 'BMW 3er 318d GT Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2016}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE46775%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Saving data for NE46775: {'auction_closing_time': 1774971588.0, 'created_time': 1773078032.533448, 'last_price_update_time': 1774873162.607817}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE46775') HTTP/1.1" 204 0
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: TY43577
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: XV86490
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: FX33595
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: CG96901
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: KE60307
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: ET54199
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: JC74188
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: BD23405
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: ME79644
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: SA42500
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: CE57838
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: GZ24181
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: PY19050
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY19050%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Scrape type for PY19050: 1
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: NE95829
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: JT01399
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: KY00599
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: WJ65165
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: BR78024
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: ZT40530
2026-03-30 12:19:22 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA18339%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.fr] INFO: Scrape type for UA18339: 2
2026-03-30 12:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc2f811-5ed2-5695-a58e-0ae32aac3e80 with identifier: UA18339
2026-03-30 12:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc2f811-5ed2-5695-a58e-0ae32aac3e80 with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc2f811-5ed2-5695-a58e-0ae32aac3e80 with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: abc2f811-5ed2-5695-a58e-0ae32aac3e80, identifier: UA18339
2026-03-30 12:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: abc2f811-5ed2-5695-a58e-0ae32aac3e80 with identifier: UA18339
2026-03-30 12:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: abc2f811-5ed2-5695-a58e-0ae32aac3e80 with identifier: UA18339
2026-03-30 12:19:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: abc2f811-5ed2-5695-a58e-0ae32aac3e80 with identifier: UA18339 to the API
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:34:21Z',
'fuel_type': 'diesel',
'id': 'abc2f811-5ed2-5695-a58e-0ae32aac3e80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA18339',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 273372,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-01',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2016}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA18339%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Saving data for UA18339: {'auction_closing_time': 1774971261.0, 'created_time': 1774279401.151989, 'last_price_update_time': 1774873163.220213}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA18339') HTTP/1.1" 204 0
2026-03-30 12:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH69982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY79941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL19951> (referer: https://www.auto1.com/v1/car-details-view/NL19951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with identifier: NL19951
2026-03-30 12:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with scrape type 1
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_2b935e1b2987a811cf7902fd738d891f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b935e1b2987a811cf7902fd738d891f.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_88056bc7be9ede1d3d4cfc889187efde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_88056bc7be9ede1d3d4cfc889187efde.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_e860bc5178283a05f7d30501eea62ded.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e860bc5178283a05f7d30501eea62ded.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_908970a71b761350983cefb293a32a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_908970a71b761350983cefb293a32a12.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_2b4f2b589802aae5be77db5077fde28d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b4f2b589802aae5be77db5077fde28d.jpg not downloaded yet
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_08d62f7e12133617c21cdeadbe55cf73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_08d62f7e12133617c21cdeadbe55cf73.jpg not downloaded yet
2026-03-30 12:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST02025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_08d62f7e12133617c21cdeadbe55cf73.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2424d0>
2026-03-30 12:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_08d62f7e12133617c21cdeadbe55cf73.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_08d62f7e12133617c21cdeadbe55cf73.jpg saved to cache
2026-03-30 12:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:19:48 [scrapy.extensions.logstats] INFO: Crawled 179 pages (at 12 pages/min), scraped 143 items (at 7 items/min)
2026-03-30 12:19:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:19:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.338(s), this was the 1st time calling it.
2026-03-30 12:19:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.280688787084624 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD23693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b4f2b589802aae5be77db5077fde28d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_908970a71b761350983cefb293a32a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac61e90>
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_2b4f2b589802aae5be77db5077fde28d.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b4f2b589802aae5be77db5077fde28d.jpg saved to cache
2026-03-30 12:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1196d0>
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_908970a71b761350983cefb293a32a12.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_908970a71b761350983cefb293a32a12.jpg saved to cache
2026-03-30 12:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:19:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD12219> (referer: https://www.auto1.com/v1/car-details-view/DD12219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e860bc5178283a05f7d30501eea62ded.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518e580b-b96f-5819-8d23-ecdc4cfba697 with identifier: DD12219
2026-03-30 12:20:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518e580b-b96f-5819-8d23-ecdc4cfba697 with scrape type 1
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_65172dbe1faab67860c216aaf16d92b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_65172dbe1faab67860c216aaf16d92b6.jpg not downloaded yet
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ab990>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_e860bc5178283a05f7d30501eea62ded.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e860bc5178283a05f7d30501eea62ded.jpg saved to cache
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg not downloaded yet
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_e77bd40f452084d024f60b189d7eeca6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e77bd40f452084d024f60b189d7eeca6.jpg not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_c883eced78f6ed8b210fbdf6ceb9509e.png%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_c883eced78f6ed8b210fbdf6ceb9509e.png not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6c64a07e35587cbea52746364428cc4b.png%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6c64a07e35587cbea52746364428cc4b.png not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg not downloaded yet
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg not downloaded yet
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bce50>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg saved to cache
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca237c10>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg saved to cache
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6c64a07e35587cbea52746364428cc4b.png> (referer: https://www.auto1.com/)
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b41bd0>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg saved to cache
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca250110>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg saved to cache
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:20:00 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:20:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b2910>
2026-03-30 12:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_7.png HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6c64a07e35587cbea52746364428cc4b.png') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6c64a07e35587cbea52746364428cc4b.png saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_c883eced78f6ed8b210fbdf6ceb9509e.png> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e77bd40f452084d024f60b189d7eeca6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_65172dbe1faab67860c216aaf16d92b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca235650>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_6.png HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_c883eced78f6ed8b210fbdf6ceb9509e.png') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_c883eced78f6ed8b210fbdf6ceb9509e.png saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca125c90>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_e77bd40f452084d024f60b189d7eeca6.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e77bd40f452084d024f60b189d7eeca6.jpg saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca250f90>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_65172dbe1faab67860c216aaf16d92b6.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_65172dbe1faab67860c216aaf16d92b6.jpg saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ae050>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_88056bc7be9ede1d3d4cfc889187efde.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:20:01 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9bf90>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_1.png HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0c906d0>
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F4e%252F164e4541e63f02c4c45894a683b63f37%252Fpa%252FDD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg saved to cache
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 518e580b-b96f-5819-8d23-ecdc4cfba697
2026-03-30 12:20:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 518e580b-b96f-5819-8d23-ecdc4cfba697, skipping ID generation
2026-03-30 12:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518e580b-b96f-5819-8d23-ecdc4cfba697 with scrape type 1
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 518e580b-b96f-5819-8d23-ecdc4cfba697 sending to next pipeline
2026-03-30 12:20:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 518e580b-b96f-5819-8d23-ecdc4cfba697, identifier: DD12219
2026-03-30 12:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 518e580b-b96f-5819-8d23-ecdc4cfba697 with identifier: DD12219
2026-03-30 12:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 518e580b-b96f-5819-8d23-ecdc4cfba697 with identifier: DD12219
2026-03-30 12:20:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 518e580b-b96f-5819-8d23-ecdc4cfba697 with identifier: DD12219 to the API
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 241,
'expiration_date': '2026-03-31T15:18:41Z',
'fuel_type': 'hybrid',
'id': '518e580b-b96f-5819-8d23-ecdc4cfba697',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD12219',
'listing': 'auction',
'location': 'FR, FOS SUR MER',
'make': 'Jeep',
'model': 'Compass',
'odometer': 95166,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e29bca0bfe8aeb00d94a206bc4f87c8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6e9b01d885d715f2f03d71b25c7cb7e2.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_39ef9bbcfbe4e5711b68f5e7c3ab6935.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_65172dbe1faab67860c216aaf16d92b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_93ec45e25d32e6c2a35f6ec835b95bfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_e77bd40f452084d024f60b189d7eeca6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_c883eced78f6ed8b210fbdf6ceb9509e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6c64a07e35587cbea52746364428cc4b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_6f59956801cc89e0eaf736ca1e60ac71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e580b-b96f-5819-8d23-ecdc4cfba697/518e580b-b96f-5819-8d23-ecdc4cfba697_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/4e/164e4541e63f02c4c45894a683b63f37/pa/DD12219_375a793a9bd29515ec2aa5da08c0bfe3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Trailhawk',
'transmission': 'automatic',
'trim': 'Trailhawk',
'year': 2022}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD12219%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.fr] INFO: Saving data for DD12219: {'created_time': 1774873202.138031, 'last_price_update_time': 1774873202.138044, 'auction_closing_time': 1774970321.0}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD12219') HTTP/1.1" 204 0
2026-03-30 12:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca100c90>
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_88056bc7be9ede1d3d4cfc889187efde.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_88056bc7be9ede1d3d4cfc889187efde.jpg saved to cache
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca104d50>
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg saved to cache
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca237910>
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg saved to cache
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b935e1b2987a811cf7902fd738d891f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:02 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: BR78024
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: ZT40530
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA18339%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.fr] INFO: Scrape type for UA18339: 0
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: WU09307
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: YS04060
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: NH60039
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: WV56090
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: NV07534
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: WX18382
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: LT10059
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: ZL96278
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: GS44106
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: DS47849
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: AB23264
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: SE79976
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: PM05502
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: XB70912
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB70912%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.fr] INFO: Scrape type for XB70912: 1
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: MT71985
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT71985%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.fr] INFO: Scrape type for MT71985: 1
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca243010>
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_2b935e1b2987a811cf7902fd738d891f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b935e1b2987a811cf7902fd738d891f.jpg saved to cache
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: WM28466
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: PF67996
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: DH19170
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: SY82143
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: PB24231
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: LZ43337
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: EC47257
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: FY82549
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: SF81175
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: YP51598
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: MS48505
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: LA37286
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA37286%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.fr] INFO: Scrape type for LA37286: 2
2026-03-30 12:20:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with identifier: LA37286
2026-03-30 12:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with scrape type 2
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with scrape type 2
2026-03-30 12:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd1ab981-d0a3-52a5-a609-76fa42bbbc8f, identifier: LA37286
2026-03-30 12:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with identifier: LA37286
2026-03-30 12:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with identifier: LA37286
2026-03-30 12:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd1ab981-d0a3-52a5-a609-76fa42bbbc8f with identifier: LA37286 to the API
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:16:09Z',
'fuel_type': 'petrol',
'id': 'fd1ab981-d0a3-52a5-a609-76fa42bbbc8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA37286',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 46347,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA37286%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Saving data for LA37286: {'auction_closing_time': 1774970169.0, 'created_time': 1773676070.645968, 'last_price_update_time': 1774873203.09526}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA37286') HTTP/1.1" 204 0
2026-03-30 12:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac65ad0>
2026-03-30 12:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F67%252F0e67b367fb48ce5de40ebd22bd96c06c%252Fpa%252FNL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg saved to cache
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d
2026-03-30 12:20:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d, skipping ID generation
2026-03-30 12:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with scrape type 1
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59c71b4c-842a-5b4b-81a5-91558a2d9c7d sending to next pipeline
2026-03-30 12:20:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d, identifier: NL19951
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: JA87898
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: BN65079
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN65079%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for BN65079: 1
2026-03-30 12:20:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with identifier: NL19951
2026-03-30 12:20:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with identifier: NL19951
2026-03-30 12:20:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59c71b4c-842a-5b4b-81a5-91558a2d9c7d with identifier: NL19951 to the API
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:15:48Z',
'fuel_type': 'petrol',
'id': '59c71b4c-842a-5b4b-81a5-91558a2d9c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL19951',
'listing': 'auction',
'location': 'FR, La Seyne-sur-Mer',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 97739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e0fa73a862c3404a736c0bdc1b261f17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b935e1b2987a811cf7902fd738d891f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_1f286a32d8a0d6d1ed6e8c5511560684.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a86ecb7559da4f4e8b09ee98409f8e11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_88056bc7be9ede1d3d4cfc889187efde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_a72ab6bd1853b79c204b44b699bfce5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_e860bc5178283a05f7d30501eea62ded.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_908970a71b761350983cefb293a32a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_2b4f2b589802aae5be77db5077fde28d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c71b4c-842a-5b4b-81a5-91558a2d9c7d/59c71b4c-842a-5b4b-81a5-91558a2d9c7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/67/0e67b367fb48ce5de40ebd22bd96c06c/pa/NL19951_08d62f7e12133617c21cdeadbe55cf73.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL19951%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Saving data for NL19951: {'created_time': 1774873203.775477, 'last_price_update_time': 1774873203.77549, 'auction_closing_time': 1774970148.0}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL19951') HTTP/1.1" 204 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: FS32024
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: JH20182
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH20182%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for JH20182: 2
2026-03-30 12:20:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56412295-144f-5d29-8a5d-e981d7eff0dc with identifier: JH20182
2026-03-30 12:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56412295-144f-5d29-8a5d-e981d7eff0dc with scrape type 2
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56412295-144f-5d29-8a5d-e981d7eff0dc with scrape type 2
2026-03-30 12:20:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56412295-144f-5d29-8a5d-e981d7eff0dc, identifier: JH20182
2026-03-30 12:20:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56412295-144f-5d29-8a5d-e981d7eff0dc with identifier: JH20182
2026-03-30 12:20:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56412295-144f-5d29-8a5d-e981d7eff0dc with identifier: JH20182
2026-03-30 12:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56412295-144f-5d29-8a5d-e981d7eff0dc with identifier: JH20182 to the API
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:38:41Z',
'fuel_type': 'diesel',
'id': '56412295-144f-5d29-8a5d-e981d7eff0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH20182',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 92226,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-29',
'seller_name': None,
'title': 'Peugeot 3008 2.0 HDi Platinum',
'transmission': 'manual',
'trim': 'Platinum',
'year': 2011}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH20182%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Saving data for JH20182: {'auction_closing_time': 1774971521.0, 'created_time': 1773693307.801047, 'last_price_update_time': 1774873204.278744}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH20182') HTTP/1.1" 204 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: YR96034
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR96034%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for YR96034: 1
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CY69551
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: WM59560
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 12:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX71466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG58458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW77264> (referer: https://www.auto1.com/v1/car-details-view/NW77264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebef3466-7609-5587-b2fa-9306968a7c37 with identifier: NW77264
2026-03-30 12:20:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebef3466-7609-5587-b2fa-9306968a7c37 with scrape type 1
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_7ee04f73a84033d8d0567e42502b90c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_7ee04f73a84033d8d0567e42502b90c5.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_5b41d4408b928d850520b866647779e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5b41d4408b928d850520b866647779e5.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_3e615c77706c1bf3e1398518dda2ca35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_3e615c77706c1bf3e1398518dda2ca35.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_f24fcf7a112aa261a76062793e88fa3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_f24fcf7a112aa261a76062793e88fa3e.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_fd849c045b07f8ecc050a854bb65fce5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_fd849c045b07f8ecc050a854bb65fce5.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_97bfc27a38f6452ce8ec360adb357b13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_97bfc27a38f6452ce8ec360adb357b13.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_5827e4a6913547f09583c2e8ceca8215.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5827e4a6913547f09583c2e8ceca8215.jpg not downloaded yet
2026-03-30 12:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE73125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5827e4a6913547f09583c2e8ceca8215.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_97bfc27a38f6452ce8ec360adb357b13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab21690>
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_5827e4a6913547f09583c2e8ceca8215.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5827e4a6913547f09583c2e8ceca8215.jpg saved to cache
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ac450>
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_97bfc27a38f6452ce8ec360adb357b13.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_97bfc27a38f6452ce8ec360adb357b13.jpg saved to cache
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH69982> (referer: https://www.auto1.com/v1/car-details-view/YH69982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_fd849c045b07f8ecc050a854bb65fce5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a717b68b-8c96-572d-9f29-abb5799c60c8 with identifier: YH69982
2026-03-30 12:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a717b68b-8c96-572d-9f29-abb5799c60c8 with scrape type 1
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a717b68b-8c96-572d-9f29-abb5799c60c8
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_18d587c6b439bc6ccfed1d8bb4ade73f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_18d587c6b439bc6ccfed1d8bb4ade73f.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_09bcc2255a2308fa485cfb45b8a6e3e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_09bcc2255a2308fa485cfb45b8a6e3e2.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_322bb71b87557cfef39226504ab15d72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_322bb71b87557cfef39226504ab15d72.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_3497fc5f4cf627eab0aaf6f7f91e21e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_3497fc5f4cf627eab0aaf6f7f91e21e9.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_bfa107cc4d5fa80bd5a7209fdff411f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_bfa107cc4d5fa80bd5a7209fdff411f2.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_e9b000c989466bf98175811bc66427e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_e9b000c989466bf98175811bc66427e2.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_55d5d25c393fdda17f813ce08de323cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_55d5d25c393fdda17f813ce08de323cc.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_69be0031dfa91c133d390dd7c41f03b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_69be0031dfa91c133d390dd7c41f03b4.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_07fe4e13799959a835b8d61f97091e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_07fe4e13799959a835b8d61f97091e35.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0d71a86208c3af7a5a99d646634a3%252Fpa%252FYH69982_6e154de1c6cf640917c5afb2b508e4c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_6e154de1c6cf640917c5afb2b508e4c6.jpg already downloaded
2026-03-30 12:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a717b68b-8c96-572d-9f29-abb5799c60c8, identifier: YH69982
2026-03-30 12:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a717b68b-8c96-572d-9f29-abb5799c60c8 with identifier: YH69982
2026-03-30 12:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a717b68b-8c96-572d-9f29-abb5799c60c8 with identifier: YH69982
2026-03-30 12:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a717b68b-8c96-572d-9f29-abb5799c60c8 with identifier: YH69982 to the API
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH69982>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:34:42Z',
'fuel_type': 'hybrid',
'id': 'a717b68b-8c96-572d-9f29-abb5799c60c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH69982',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'Kuga',
'odometer': 28321,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photo_urls': ['https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_18d587c6b439bc6ccfed1d8bb4ade73f.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_09bcc2255a2308fa485cfb45b8a6e3e2.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_322bb71b87557cfef39226504ab15d72.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_3497fc5f4cf627eab0aaf6f7f91e21e9.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_bfa107cc4d5fa80bd5a7209fdff411f2.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_e9b000c989466bf98175811bc66427e2.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_55d5d25c393fdda17f813ce08de323cc.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_69be0031dfa91c133d390dd7c41f03b4.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_07fe4e13799959a835b8d61f97091e35.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_6e154de1c6cf640917c5afb2b508e4c6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_18d587c6b439bc6ccfed1d8bb4ade73f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_09bcc2255a2308fa485cfb45b8a6e3e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_322bb71b87557cfef39226504ab15d72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_3497fc5f4cf627eab0aaf6f7f91e21e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_bfa107cc4d5fa80bd5a7209fdff411f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_e9b000c989466bf98175811bc66427e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_55d5d25c393fdda17f813ce08de323cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_69be0031dfa91c133d390dd7c41f03b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_07fe4e13799959a835b8d61f97091e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717b68b-8c96-572d-9f29-abb5799c60c8/a717b68b-8c96-572d-9f29-abb5799c60c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0d71a86208c3af7a5a99d646634a3/pa/YH69982_6e154de1c6cf640917c5afb2b508e4c6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2024}
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH69982%27 HTTP/1.1" 200 None
2026-03-30 12:20:24 [auto1.fr] INFO: Saving data for YH69982: {'created_time': 1774873224.02981, 'last_price_update_time': 1774873224.029819, 'auction_closing_time': 1774971282.0}
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH69982') HTTP/1.1" 204 0
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_f24fcf7a112aa261a76062793e88fa3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ae4d0>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_fd849c045b07f8ecc050a854bb65fce5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_fd849c045b07f8ecc050a854bb65fce5.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_3e615c77706c1bf3e1398518dda2ca35.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922ee50>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_f24fcf7a112aa261a76062793e88fa3e.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_f24fcf7a112aa261a76062793e88fa3e.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5b41d4408b928d850520b866647779e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0faa3d0>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_3e615c77706c1bf3e1398518dda2ca35.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_3e615c77706c1bf3e1398518dda2ca35.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12ff10>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_5b41d4408b928d850520b866647779e5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5b41d4408b928d850520b866647779e5.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_7ee04f73a84033d8d0567e42502b90c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca242f90>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca240fd0>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2eba90>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_7ee04f73a84033d8d0567e42502b90c5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_7ee04f73a84033d8d0567e42502b90c5.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2fa010>
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F4b%252Fa14b9ef84afdad8fcc2eadfe79f34311%252Fpa%252FNW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg saved to cache
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebef3466-7609-5587-b2fa-9306968a7c37
2026-03-30 12:20:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebef3466-7609-5587-b2fa-9306968a7c37, skipping ID generation
2026-03-30 12:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebef3466-7609-5587-b2fa-9306968a7c37 with scrape type 1
2026-03-30 12:20:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebef3466-7609-5587-b2fa-9306968a7c37 sending to next pipeline
2026-03-30 12:20:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebef3466-7609-5587-b2fa-9306968a7c37, identifier: NW77264
2026-03-30 12:20:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebef3466-7609-5587-b2fa-9306968a7c37 with identifier: NW77264
2026-03-30 12:20:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebef3466-7609-5587-b2fa-9306968a7c37 with identifier: NW77264
2026-03-30 12:20:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebef3466-7609-5587-b2fa-9306968a7c37 with identifier: NW77264 to the API
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:20:57Z',
'fuel_type': 'diesel',
'id': 'ebef3466-7609-5587-b2fa-9306968a7c37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW77264',
'listing': 'auction',
'location': 'FR, Sainte-Geneviève-des-Bois',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 185281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_06017c30144273d5b9c9f90f8b3ce9c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_7ee04f73a84033d8d0567e42502b90c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_c6dc62b51991b5c1b01b0e07912d3d8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_183c36fbd09f3f65a3ba643ff73857dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5b41d4408b928d850520b866647779e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_3e615c77706c1bf3e1398518dda2ca35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_f24fcf7a112aa261a76062793e88fa3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_fd849c045b07f8ecc050a854bb65fce5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_97bfc27a38f6452ce8ec360adb357b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebef3466-7609-5587-b2fa-9306968a7c37/ebef3466-7609-5587-b2fa-9306968a7c37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/4b/a14b9ef84afdad8fcc2eadfe79f34311/pa/NW77264_5827e4a6913547f09583c2e8ceca8215.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-05',
'seats_number': 8,
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Shine M',
'transmission': 'automatic',
'trim': 'Shine M',
'year': 2019}
2026-03-30 12:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW77264%27 HTTP/1.1" 200 None
2026-03-30 12:20:25 [auto1.fr] INFO: Saving data for NW77264: {'created_time': 1774873225.235781, 'last_price_update_time': 1774873225.235792, 'auction_closing_time': 1774970457.0}
2026-03-30 12:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW77264') HTTP/1.1" 204 0
2026-03-30 12:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST02025> (referer: https://www.auto1.com/v1/car-details-view/ST02025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b58d84-4db7-5870-8839-6033ee61dd45 with identifier: ST02025
2026-03-30 12:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b58d84-4db7-5870-8839-6033ee61dd45 with scrape type 1
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_c47ad3b55a435b2239268568205345e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_c47ad3b55a435b2239268568205345e8.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_8bfadd190f6653e2b8327a5cb064b609.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_8bfadd190f6653e2b8327a5cb064b609.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_205fec09cc4c7935d86611429719c170.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_205fec09cc4c7935d86611429719c170.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_d639bbb4dae5b4570b13d604fddae191.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_d639bbb4dae5b4570b13d604fddae191.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg not downloaded yet
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg not downloaded yet
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD23693> (referer: https://www.auto1.com/v1/car-details-view/BD23693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2 with identifier: BD23693
2026-03-30 12:20:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2 with scrape type 1
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_47276a2e1d87c44f9f770eab868dfc4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_47276a2e1d87c44f9f770eab868dfc4d.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_adf3c6cc9f2b528d8efcc19f22e635c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_adf3c6cc9f2b528d8efcc19f22e635c9.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_641f9e794e0842fd322b225b7b028371.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_641f9e794e0842fd322b225b7b028371.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_f5d0f4b36685e5f1173ed3fa039f9f81.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_f5d0f4b36685e5f1173ed3fa039f9f81.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_911d76c84411bad66c71099d6bf2825f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_911d76c84411bad66c71099d6bf2825f.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_cf6ae3d686c125c4e12f5161513e9ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_cf6ae3d686c125c4e12f5161513e9ede.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_d3f62423010b7fe1f36449a3767ef931.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_d3f62423010b7fe1f36449a3767ef931.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_5b31ea3904a0e5a436a86a624c70d4b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_5b31ea3904a0e5a436a86a624c70d4b7.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_7cf05ce8939dd1080f2c1d679264e9f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_7cf05ce8939dd1080f2c1d679264e9f3.jpg already downloaded
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Ff6%252Fadf64317ec9727682bb76544613ecad4%252Fpa%252FBD23693_6915b5ab5ff282c50d2fe7d70363c619.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_6915b5ab5ff282c50d2fe7d70363c619.jpg already downloaded
2026-03-30 12:20:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2, identifier: BD23693
2026-03-30 12:20:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2 with identifier: BD23693
2026-03-30 12:20:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2 with identifier: BD23693
2026-03-30 12:20:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62aebf4e-185b-59f3-b4f4-8eb9398a1ee2 with identifier: BD23693 to the API
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD23693>
{'auction_title': '',
'c_o_2_emission_value': 92,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:38:05Z',
'fuel_type': 'diesel',
'id': '62aebf4e-185b-59f3-b4f4-8eb9398a1ee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD23693',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Renault',
'model': 'Clio',
'odometer': 336168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_47276a2e1d87c44f9f770eab868dfc4d.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_adf3c6cc9f2b528d8efcc19f22e635c9.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_641f9e794e0842fd322b225b7b028371.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_f5d0f4b36685e5f1173ed3fa039f9f81.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_911d76c84411bad66c71099d6bf2825f.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_cf6ae3d686c125c4e12f5161513e9ede.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_d3f62423010b7fe1f36449a3767ef931.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_5b31ea3904a0e5a436a86a624c70d4b7.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_7cf05ce8939dd1080f2c1d679264e9f3.jpg',
'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_6915b5ab5ff282c50d2fe7d70363c619.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_47276a2e1d87c44f9f770eab868dfc4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_adf3c6cc9f2b528d8efcc19f22e635c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_641f9e794e0842fd322b225b7b028371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_f5d0f4b36685e5f1173ed3fa039f9f81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_911d76c84411bad66c71099d6bf2825f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1900030,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_cf6ae3d686c125c4e12f5161513e9ede.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1883942,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_d3f62423010b7fe1f36449a3767ef931.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2027443,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_5b31ea3904a0e5a436a86a624c70d4b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_7cf05ce8939dd1080f2c1d679264e9f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62aebf4e-185b-59f3-b4f4-8eb9398a1ee2/62aebf4e-185b-59f3-b4f4-8eb9398a1ee2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/f6/adf64317ec9727682bb76544613ecad4/pa/BD23693_6915b5ab5ff282c50d2fe7d70363c619.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2017}
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD23693%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [auto1.fr] INFO: Saving data for BD23693: {'created_time': 1774873230.327163, 'last_price_update_time': 1774873230.327174, 'auction_closing_time': 1774971485.0}
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD23693') HTTP/1.1" 204 0
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0ad4390>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15dd10>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_d639bbb4dae5b4570b13d604fddae191.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15f5d0>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_205fec09cc4c7935d86611429719c170.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab22790>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_d639bbb4dae5b4570b13d604fddae191.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_d639bbb4dae5b4570b13d604fddae191.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922d7d0>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_205fec09cc4c7935d86611429719c170.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_205fec09cc4c7935d86611429719c170.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_8bfadd190f6653e2b8327a5cb064b609.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c4210>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0adf950>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_c47ad3b55a435b2239268568205345e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f9610>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_8bfadd190f6653e2b8327a5cb064b609.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_8bfadd190f6653e2b8327a5cb064b609.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f61d0>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac70d90>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898c30bb4f998f6030d2e0fe9255c75%252Fpa%252FST02025_c47ad3b55a435b2239268568205345e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_c47ad3b55a435b2239268568205345e8.jpg saved to cache
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28b58d84-4db7-5870-8839-6033ee61dd45
2026-03-30 12:20:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28b58d84-4db7-5870-8839-6033ee61dd45, skipping ID generation
2026-03-30 12:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b58d84-4db7-5870-8839-6033ee61dd45 with scrape type 1
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28b58d84-4db7-5870-8839-6033ee61dd45 sending to next pipeline
2026-03-30 12:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28b58d84-4db7-5870-8839-6033ee61dd45, identifier: ST02025
2026-03-30 12:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28b58d84-4db7-5870-8839-6033ee61dd45 with identifier: ST02025
2026-03-30 12:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28b58d84-4db7-5870-8839-6033ee61dd45 with identifier: ST02025
2026-03-30 12:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28b58d84-4db7-5870-8839-6033ee61dd45 with identifier: ST02025 to the API
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_c47ad3b55a435b2239268568205345e8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:45Z',
'fuel_type': 'petrol',
'id': '28b58d84-4db7-5870-8839-6033ee61dd45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST02025',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 121650,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_c47ad3b55a435b2239268568205345e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_7059d1a0106ba4f28e2897a2fd5350c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_8bfadd190f6653e2b8327a5cb064b609.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_a3e3528c5ee556b3d36a55eacdcaec4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_846ff6a56ab78caf0d0ba2aba9518fe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_205fec09cc4c7935d86611429719c170.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_d639bbb4dae5b4570b13d604fddae191.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c64ef941b9077cd95bcbaeaa70d26ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_6c8138ab7aa36f54048f5b8f837cf4e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b58d84-4db7-5870-8839-6033ee61dd45/28b58d84-4db7-5870-8839-6033ee61dd45_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898c30bb4f998f6030d2e0fe9255c75/pa/ST02025_84f0c5155f8b11ddf9f50d6b4d55ac71.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST02025%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Saving data for ST02025: {'created_time': 1774873231.91082, 'last_price_update_time': 1774873231.91083, 'auction_closing_time': 1774971885.0}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST02025') HTTP/1.1" 204 0
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY19050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB70912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 263.439(s), this was the 2nd time calling it.
2026-03-30 12:20:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.007994221628502 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:20:48 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 12 pages/min), scraped 151 items (at 8 items/min)
2026-03-30 12:20:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR96034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX71466> (referer: https://www.auto1.com/v1/car-details-view/RX71466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79ca090c-8119-5d78-aa58-4fb59f4771b5 with identifier: RX71466
2026-03-30 12:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79ca090c-8119-5d78-aa58-4fb59f4771b5 with scrape type 1
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_6d165e108224c53f736a157f2e9ddbb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6d165e108224c53f736a157f2e9ddbb6.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_a532fa50b0f91f59d5766e935bd50749.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a532fa50b0f91f59d5766e935bd50749.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg not downloaded yet
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_767b09869d139f36927a67c57a7d1a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_767b09869d139f36927a67c57a7d1a13.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_6ca045fcd523433bcacba786540d2a73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6ca045fcd523433bcacba786540d2a73.jpg not downloaded yet
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg not downloaded yet
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6ca045fcd523433bcacba786540d2a73.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0c70e10>
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg saved to cache
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_767b09869d139f36927a67c57a7d1a13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab7cad0>
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg saved to cache
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2363d0>
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg saved to cache
2026-03-30 12:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac73d50>
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a532fa50b0f91f59d5766e935bd50749.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca155e10>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_6ca045fcd523433bcacba786540d2a73.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6ca045fcd523433bcacba786540d2a73.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca259950>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab8f910>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_767b09869d139f36927a67c57a7d1a13.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_767b09869d139f36927a67c57a7d1a13.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6d165e108224c53f736a157f2e9ddbb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c04d0>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_a532fa50b0f91f59d5766e935bd50749.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a532fa50b0f91f59d5766e935bd50749.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca181d50>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_6d165e108224c53f736a157f2e9ddbb6.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6d165e108224c53f736a157f2e9ddbb6.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca146d50>
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F2c%252F1a2ca4d619d079e44f0daf17739ccb95%252Fpa%252FRX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg saved to cache
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79ca090c-8119-5d78-aa58-4fb59f4771b5
2026-03-30 12:20:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79ca090c-8119-5d78-aa58-4fb59f4771b5, skipping ID generation
2026-03-30 12:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79ca090c-8119-5d78-aa58-4fb59f4771b5 with scrape type 1
2026-03-30 12:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79ca090c-8119-5d78-aa58-4fb59f4771b5 sending to next pipeline
2026-03-30 12:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79ca090c-8119-5d78-aa58-4fb59f4771b5, identifier: RX71466
2026-03-30 12:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79ca090c-8119-5d78-aa58-4fb59f4771b5 with identifier: RX71466
2026-03-30 12:20:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79ca090c-8119-5d78-aa58-4fb59f4771b5 with identifier: RX71466
2026-03-30 12:20:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79ca090c-8119-5d78-aa58-4fb59f4771b5 with identifier: RX71466 to the API
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 132,
'expiration_date': '2026-03-31T15:47:19Z',
'fuel_type': 'petrol',
'id': '79ca090c-8119-5d78-aa58-4fb59f4771b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX71466',
'listing': 'auction',
'location': 'FR, Bourg-en-Bresse',
'make': 'Renault',
'model': 'Scenic',
'odometer': 84839,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_2e366780935df0bc2b1cfbeb87d7db6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_851f04ea4e1698c0f3960bb1ff4a97c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a1dfe5eaa523fe97d23eba1a91e7bf44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6d165e108224c53f736a157f2e9ddbb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_a532fa50b0f91f59d5766e935bd50749.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1146c5e7e5e70405c57f87f0f7ea97ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_1ee640d4c092a77d323a63d68f0fbdc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_767b09869d139f36927a67c57a7d1a13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_6ca045fcd523433bcacba786540d2a73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79ca090c-8119-5d78-aa58-4fb59f4771b5/79ca090c-8119-5d78-aa58-4fb59f4771b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/2c/1a2ca4d619d079e44f0daf17739ccb95/pa/RX71466_fe15b18ac891d2c8330537a4b328b6d1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.2 TCe Energy BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2016}
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX71466%27 HTTP/1.1" 200 None
2026-03-30 12:20:52 [auto1.fr] INFO: Saving data for RX71466: {'created_time': 1774873252.860246, 'last_price_update_time': 1774873252.860258, 'auction_closing_time': 1774972039.0}
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX71466') HTTP/1.1" 204 0
2026-03-30 12:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY79941> (referer: https://www.auto1.com/v1/car-details-view/PY79941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12035a2-ae30-57c0-8d2c-ac65e7713a9e with identifier: PY79941
2026-03-30 12:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12035a2-ae30-57c0-8d2c-ac65e7713a9e with scrape type 1
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e12035a2-ae30-57c0-8d2c-ac65e7713a9e
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_2800b7cd848be073ff6b4185d1ad319e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2800b7cd848be073ff6b4185d1ad319e.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_03455073897c4ff7286f9c263602e75c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_03455073897c4ff7286f9c263602e75c.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_2dd759706cb1f16865dc0c193ae7be4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2dd759706cb1f16865dc0c193ae7be4a.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_32b3a6976cb193e624e4b16e7f871e16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_32b3a6976cb193e624e4b16e7f871e16.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_59e3fd2575493b7ce83356440bf58552.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_59e3fd2575493b7ce83356440bf58552.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_332ca72f14400151762b45156fc1151b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_332ca72f14400151762b45156fc1151b.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_9b59e2035f5db84f37e2e3e8c9883a89.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_9b59e2035f5db84f37e2e3e8c9883a89.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_2c93dcaec5535ee63a968c17dcd88bf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2c93dcaec5535ee63a968c17dcd88bf0.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_3137d870f3a844ca7fd84cdbf3379ce7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_3137d870f3a844ca7fd84cdbf3379ce7.jpg already downloaded
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd5%252F38d5ea8e0b71964703a93482620a9529%252Fpa%252FPY79941_8c5dc33e8e6e0e6b58acaa050fb0c49d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_8c5dc33e8e6e0e6b58acaa050fb0c49d.jpg already downloaded
2026-03-30 12:20:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e12035a2-ae30-57c0-8d2c-ac65e7713a9e, identifier: PY79941
2026-03-30 12:20:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e12035a2-ae30-57c0-8d2c-ac65e7713a9e with identifier: PY79941
2026-03-30 12:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e12035a2-ae30-57c0-8d2c-ac65e7713a9e with identifier: PY79941
2026-03-30 12:20:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e12035a2-ae30-57c0-8d2c-ac65e7713a9e with identifier: PY79941 to the API
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PY79941>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:36:30Z',
'fuel_type': 'diesel',
'id': 'e12035a2-ae30-57c0-8d2c-ac65e7713a9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY79941',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Peugeot',
'model': '5008',
'odometer': 190149,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2800b7cd848be073ff6b4185d1ad319e.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_03455073897c4ff7286f9c263602e75c.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2dd759706cb1f16865dc0c193ae7be4a.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_32b3a6976cb193e624e4b16e7f871e16.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_59e3fd2575493b7ce83356440bf58552.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_332ca72f14400151762b45156fc1151b.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_9b59e2035f5db84f37e2e3e8c9883a89.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2c93dcaec5535ee63a968c17dcd88bf0.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_3137d870f3a844ca7fd84cdbf3379ce7.jpg',
'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_8c5dc33e8e6e0e6b58acaa050fb0c49d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762607,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2800b7cd848be073ff6b4185d1ad319e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_03455073897c4ff7286f9c263602e75c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2dd759706cb1f16865dc0c193ae7be4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_32b3a6976cb193e624e4b16e7f871e16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2731577,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_59e3fd2575493b7ce83356440bf58552.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_332ca72f14400151762b45156fc1151b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_9b59e2035f5db84f37e2e3e8c9883a89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2714200,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_2c93dcaec5535ee63a968c17dcd88bf0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_3137d870f3a844ca7fd84cdbf3379ce7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12035a2-ae30-57c0-8d2c-ac65e7713a9e/e12035a2-ae30-57c0-8d2c-ac65e7713a9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/d5/38d5ea8e0b71964703a93482620a9529/pa/PY79941_8c5dc33e8e6e0e6b58acaa050fb0c49d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-30 12:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY79941%27 HTTP/1.1" 200 None
2026-03-30 12:20:55 [auto1.fr] INFO: Saving data for PY79941: {'created_time': 1774873255.057726, 'last_price_update_time': 1774873255.057736, 'auction_closing_time': 1774971390.0}
2026-03-30 12:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY79941') HTTP/1.1" 204 0
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG58458> (referer: https://www.auto1.com/v1/car-details-view/MG58458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW05670> (referer: https://www.auto1.com/v1/car-details-view/FW05670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b741eb49-463e-517d-86ef-8de16b52c03f with identifier: MG58458
2026-03-30 12:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b741eb49-463e-517d-86ef-8de16b52c03f with scrape type 1
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_79244aa9f6d31b19309c414534648a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_79244aa9f6d31b19309c414534648a63.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_1d8295fbbff123f126252ce61c246f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_1d8295fbbff123f126252ce61c246f61.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg not downloaded yet
2026-03-30 12:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with identifier: FW05670
2026-03-30 12:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with scrape type 1
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg not downloaded yet
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_79244aa9f6d31b19309c414534648a63.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg not downloaded yet
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_7e8255344d067aa085ae50bd62241e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_7e8255344d067aa085ae50bd62241e47.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_205e00826edc9f7f0c4a18af7274edde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_205e00826edc9f7f0c4a18af7274edde.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_5c0b67603d5242333576de07a9f0bd51.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_5c0b67603d5242333576de07a9f0bd51.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_3a8c1508eb41d23a494457786527f26f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_3a8c1508eb41d23a494457786527f26f.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_db738513618e5567f1c0ca1b8ed3454b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_db738513618e5567f1c0ca1b8ed3454b.jpg not downloaded yet
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_20f86f808de26e82b445fcf23d4f5163.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_20f86f808de26e82b445fcf23d4f5163.jpg not downloaded yet
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_e63db78dadf47df6471e8ff0f42d584f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_e63db78dadf47df6471e8ff0f42d584f.jpg not downloaded yet
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c28d0>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_79244aa9f6d31b19309c414534648a63.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_79244aa9f6d31b19309c414534648a63.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab6a190>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c1590>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg not downloaded yet
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca148490>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg not downloaded yet
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_db738513618e5567f1c0ca1b8ed3454b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_20f86f808de26e82b445fcf23d4f5163.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_494b65f38b44388abd327be64acddfc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_494b65f38b44388abd327be64acddfc4.jpg not downloaded yet
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_e63db78dadf47df6471e8ff0f42d584f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_1d8295fbbff123f126252ce61c246f61.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_04bf6decb005a5c2840b59ca101cbf62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_04bf6decb005a5c2840b59ca101cbf62.jpg not downloaded yet
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab22450>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922c2d0>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_3a8c1508eb41d23a494457786527f26f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24ee10>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_db738513618e5567f1c0ca1b8ed3454b.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_db738513618e5567f1c0ca1b8ed3454b.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca155350>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_20f86f808de26e82b445fcf23d4f5163.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_20f86f808de26e82b445fcf23d4f5163.jpg saved to cache
2026-03-30 12:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f6550>
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_e63db78dadf47df6471e8ff0f42d584f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_e63db78dadf47df6471e8ff0f42d584f.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca175990>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_1d8295fbbff123f126252ce61c246f61.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_1d8295fbbff123f126252ce61c246f61.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_494b65f38b44388abd327be64acddfc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_04bf6decb005a5c2840b59ca101cbf62.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_5c0b67603d5242333576de07a9f0bd51.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcacf4610>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f8890>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2516d0>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca265550>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_3a8c1508eb41d23a494457786527f26f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_3a8c1508eb41d23a494457786527f26f.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_205e00826edc9f7f0c4a18af7274edde.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_7e8255344d067aa085ae50bd62241e47.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f8a90>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_494b65f38b44388abd327be64acddfc4.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_494b65f38b44388abd327be64acddfc4.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b0390>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_04bf6decb005a5c2840b59ca101cbf62.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_04bf6decb005a5c2840b59ca101cbf62.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca25b050>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_5c0b67603d5242333576de07a9f0bd51.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_5c0b67603d5242333576de07a9f0bd51.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd01a1150>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_205e00826edc9f7f0c4a18af7274edde.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_205e00826edc9f7f0c4a18af7274edde.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e8e10>
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F34%252F8834b959cf2824356cd3c9587cab50ef%252Fpa%252FMG58458_7e8255344d067aa085ae50bd62241e47.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_7e8255344d067aa085ae50bd62241e47.jpg saved to cache
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b741eb49-463e-517d-86ef-8de16b52c03f
2026-03-30 12:20:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b741eb49-463e-517d-86ef-8de16b52c03f, skipping ID generation
2026-03-30 12:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b741eb49-463e-517d-86ef-8de16b52c03f with scrape type 1
2026-03-30 12:20:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b741eb49-463e-517d-86ef-8de16b52c03f sending to next pipeline
2026-03-30 12:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b741eb49-463e-517d-86ef-8de16b52c03f, identifier: MG58458
2026-03-30 12:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b741eb49-463e-517d-86ef-8de16b52c03f with identifier: MG58458
2026-03-30 12:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b741eb49-463e-517d-86ef-8de16b52c03f with identifier: MG58458
2026-03-30 12:20:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b741eb49-463e-517d-86ef-8de16b52c03f with identifier: MG58458 to the API
2026-03-30 12:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_7e8255344d067aa085ae50bd62241e47.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:03:28Z',
'fuel_type': 'diesel',
'id': 'b741eb49-463e-517d-86ef-8de16b52c03f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG58458',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 150450,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_79244aa9f6d31b19309c414534648a63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_c55e1efd5bd3d3199f14babb5a1472a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_da74cf9e6ab1ee1a96d2cb50acf5793a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_1d8295fbbff123f126252ce61c246f61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_0bbf9eaf45cf33fc2883122b8394f73c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_3ee207ddcc3160d128d61a963a3d7e7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_bc0feecb6c8e4bd1755b8251a7d0ba89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_7e8255344d067aa085ae50bd62241e47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_5c0b67603d5242333576de07a9f0bd51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b741eb49-463e-517d-86ef-8de16b52c03f/b741eb49-463e-517d-86ef-8de16b52c03f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834b959cf2824356cd3c9587cab50ef/pa/MG58458_db738513618e5567f1c0ca1b8ed3454b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-19',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2012}
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG58458%27 HTTP/1.1" 200 None
2026-03-30 12:20:58 [auto1.fr] INFO: Saving data for MG58458: {'created_time': 1774873258.194266, 'last_price_update_time': 1774873258.194277, 'auction_closing_time': 1774969408.0}
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG58458') HTTP/1.1" 204 0
2026-03-30 12:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922a4d0>
2026-03-30 12:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fd4%252Fe7d430fbbe5a91a0cfdcc7321961f221%252Fpa%252FFW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg saved to cache
2026-03-30 12:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f
2026-03-30 12:20:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f, skipping ID generation
2026-03-30 12:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with scrape type 1
2026-03-30 12:20:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f sending to next pipeline
2026-03-30 12:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f, identifier: FW05670
2026-03-30 12:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with identifier: FW05670
2026-03-30 12:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with identifier: FW05670
2026-03-30 12:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f with identifier: FW05670 to the API
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:09:00Z',
'fuel_type': 'diesel',
'id': 'dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW05670',
'listing': 'auction',
'location': 'FR, Saint-Dizier',
'make': 'BMW',
'model': '3er',
'odometer': 138413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_65a777dcd47a02d58a1ab1766f3fd0b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_666ff1b15fe997dd7708b52d1a2b9389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_205e00826edc9f7f0c4a18af7274edde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_3a8c1508eb41d23a494457786527f26f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_20f86f808de26e82b445fcf23d4f5163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_e63db78dadf47df6471e8ff0f42d584f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_0ecc399d098dfecf7d613c86b1cc812f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_d7b91569595d9ed332e0bd982bf74ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_494b65f38b44388abd327be64acddfc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f/dc0d4f8a-6bc5-50cc-98e0-534c6cd4887f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/d4/e7d430fbbe5a91a0cfdcc7321961f221/pa/FW05670_04bf6decb005a5c2840b59ca101cbf62.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW05670%27 HTTP/1.1" 200 None
2026-03-30 12:20:58 [auto1.fr] INFO: Saving data for FW05670: {'created_time': 1774873258.784989, 'last_price_update_time': 1774873258.784999, 'auction_closing_time': 1774969740.0}
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW05670') HTTP/1.1" 204 0
2026-03-30 12:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT71985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY19050> (referer: https://www.auto1.com/v1/car-details-view/PY19050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with identifier: PY19050
2026-03-30 12:21:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with scrape type 1
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_5d096e13e33e16ca90dbf44915d584a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_5d096e13e33e16ca90dbf44915d584a0.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_c9e0b251af74ccd06cd8679752a8a734.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_c9e0b251af74ccd06cd8679752a8a734.jpg not downloaded yet
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_5d096e13e33e16ca90dbf44915d584a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg not downloaded yet
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg not downloaded yet
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_d7da1351191676e532b78b1c78cc87cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_d7da1351191676e532b78b1c78cc87cd.jpg not downloaded yet
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg not downloaded yet
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_c9e0b251af74ccd06cd8679752a8a734.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab48110>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_5d096e13e33e16ca90dbf44915d584a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_5d096e13e33e16ca90dbf44915d584a0.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b1a10>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_d7da1351191676e532b78b1c78cc87cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cb150>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca18f050>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca144a90>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_c9e0b251af74ccd06cd8679752a8a734.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_c9e0b251af74ccd06cd8679752a8a734.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca226c50>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca145090>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac786d0>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg saved to cache
2026-03-30 12:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab42450>
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_d7da1351191676e532b78b1c78cc87cd.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_d7da1351191676e532b78b1c78cc87cd.jpg saved to cache
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26f710>
2026-03-30 12:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fce%252F50ceb83b64ac9522b4a5bd92a4a50ad1%252Fpa%252FPY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg saved to cache
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1
2026-03-30 12:21:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1, skipping ID generation
2026-03-30 12:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with scrape type 1
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 sending to next pipeline
2026-03-30 12:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1, identifier: PY19050
2026-03-30 12:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with identifier: PY19050
2026-03-30 12:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with identifier: PY19050
2026-03-30 12:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a4eaa65-4738-5aa9-9cff-d8ad97d308a1 with identifier: PY19050 to the API
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:30:29Z',
'fuel_type': 'diesel',
'id': '5a4eaa65-4738-5aa9-9cff-d8ad97d308a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY19050',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Espace',
'odometer': 152280,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_5d096e13e33e16ca90dbf44915d584a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_a55a3c5ccea249ec72edc79afa09f64c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_e825c9026d7ab92cfc0c04bfd83079bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cd5fefabde0c76f617fa05e1d95ae99f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0e1ccd549c95bc2f0b24d3d293f4964f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_c9e0b251af74ccd06cd8679752a8a734.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_cc58e7f14c4fcd7c25d06af6401a5928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_0c9fe55fe3cb8f2cfd7f9d1979ec9374.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_d7da1351191676e532b78b1c78cc87cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a4eaa65-4738-5aa9-9cff-d8ad97d308a1/5a4eaa65-4738-5aa9-9cff-d8ad97d308a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ce/50ceb83b64ac9522b4a5bd92a4a50ad1/pa/PY19050_f72cf91c12fb84be3cb031ddffe7383d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-19',
'seats_number': 7,
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2017}
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY19050%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [auto1.fr] INFO: Saving data for PY19050: {'created_time': 1774873261.577242, 'last_price_update_time': 1774873261.577252, 'auction_closing_time': 1774971029.0}
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY19050') HTTP/1.1" 204 0
2026-03-30 12:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB70912> (referer: https://www.auto1.com/v1/car-details-view/XB70912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 781d8202-df5d-57e0-840a-3aa2779842e4 with identifier: XB70912
2026-03-30 12:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 781d8202-df5d-57e0-840a-3aa2779842e4 with scrape type 1
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 781d8202-df5d-57e0-840a-3aa2779842e4
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_e8db36b966e193ddc09ae588d635b6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_e8db36b966e193ddc09ae588d635b6a0.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_225fe8ea3b06fdf2564484f6920bc48d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_225fe8ea3b06fdf2564484f6920bc48d.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_2856bb9bfb977e020c8f295401f54794.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2856bb9bfb977e020c8f295401f54794.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_19c1a8fc52a489273413de7fa7389aeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_19c1a8fc52a489273413de7fa7389aeb.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_df38b0421002a154eb2688c23c93e33c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_df38b0421002a154eb2688c23c93e33c.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_2bc9ea8148cd5f320ef363cb598d6e53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2bc9ea8148cd5f320ef363cb598d6e53.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_d4b636bb3383fa1d49ceb24cdf3010ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_d4b636bb3383fa1d49ceb24cdf3010ae.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_22731701d18ddf54b9933a38b31e42b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_22731701d18ddf54b9933a38b31e42b6.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_9d2f30c69de5c29bb76f87006c3a7bf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_9d2f30c69de5c29bb76f87006c3a7bf7.jpg already downloaded
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdf%252F06df0321b3dcd67cbda2abd52619e6ae%252Fpa%252FXB70912_4c4c16f2b6de66af71fbbc2408b88be2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_4c4c16f2b6de66af71fbbc2408b88be2.jpg already downloaded
2026-03-30 12:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 781d8202-df5d-57e0-840a-3aa2779842e4, identifier: XB70912
2026-03-30 12:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 781d8202-df5d-57e0-840a-3aa2779842e4 with identifier: XB70912
2026-03-30 12:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 781d8202-df5d-57e0-840a-3aa2779842e4 with identifier: XB70912
2026-03-30 12:21:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 781d8202-df5d-57e0-840a-3aa2779842e4 with identifier: XB70912 to the API
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB70912>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:53:35Z',
'fuel_type': 'diesel',
'id': '781d8202-df5d-57e0-840a-3aa2779842e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB70912',
'listing': 'auction',
'location': 'FR, Le Cellier',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 244810,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_e8db36b966e193ddc09ae588d635b6a0.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_225fe8ea3b06fdf2564484f6920bc48d.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2856bb9bfb977e020c8f295401f54794.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_19c1a8fc52a489273413de7fa7389aeb.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_df38b0421002a154eb2688c23c93e33c.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2bc9ea8148cd5f320ef363cb598d6e53.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_d4b636bb3383fa1d49ceb24cdf3010ae.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_22731701d18ddf54b9933a38b31e42b6.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_9d2f30c69de5c29bb76f87006c3a7bf7.jpg',
'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_4c4c16f2b6de66af71fbbc2408b88be2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_e8db36b966e193ddc09ae588d635b6a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_225fe8ea3b06fdf2564484f6920bc48d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2856bb9bfb977e020c8f295401f54794.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3202715,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_19c1a8fc52a489273413de7fa7389aeb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3224750,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_df38b0421002a154eb2688c23c93e33c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3039739,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_2bc9ea8148cd5f320ef363cb598d6e53.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_d4b636bb3383fa1d49ceb24cdf3010ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_22731701d18ddf54b9933a38b31e42b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_9d2f30c69de5c29bb76f87006c3a7bf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d8202-df5d-57e0-840a-3aa2779842e4/781d8202-df5d-57e0-840a-3aa2779842e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/df/06df0321b3dcd67cbda2abd52619e6ae/pa/XB70912_4c4c16f2b6de66af71fbbc2408b88be2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Connect Edition',
'transmission': 'manual',
'trim': 'Connect Edition',
'year': 2011}
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB70912%27 HTTP/1.1" 200 None
2026-03-30 12:21:02 [auto1.fr] INFO: Saving data for XB70912: {'created_time': 1774873262.313659, 'last_price_update_time': 1774873262.313668, 'auction_closing_time': 1774972415.0}
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB70912') HTTP/1.1" 204 0
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:05 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY97876%27 HTTP/1.1" 200 None
2026-03-30 12:21:05 [auto1.fr] INFO: Scrape type for KY97876: 1
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: SC94219
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: NL15141
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN08846%27 HTTP/1.1" 200 None
2026-03-30 12:21:05 [auto1.fr] INFO: Scrape type for ZN08846: 1
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX85984%27 HTTP/1.1" 200 None
2026-03-30 12:21:05 [auto1.fr] INFO: Scrape type for FX85984: 1
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV38404%27 HTTP/1.1" 200 None
2026-03-30 12:21:05 [auto1.fr] INFO: Scrape type for RV38404: 1
2026-03-30 12:21:05 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ76593%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [auto1.fr] INFO: Scrape type for XJ76593: 2
2026-03-30 12:21:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85241851-e67a-5ea1-b6f2-834d94e8d009 with identifier: XJ76593
2026-03-30 12:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85241851-e67a-5ea1-b6f2-834d94e8d009 with scrape type 2
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85241851-e67a-5ea1-b6f2-834d94e8d009 with scrape type 2
2026-03-30 12:21:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85241851-e67a-5ea1-b6f2-834d94e8d009, identifier: XJ76593
2026-03-30 12:21:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85241851-e67a-5ea1-b6f2-834d94e8d009 with identifier: XJ76593
2026-03-30 12:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85241851-e67a-5ea1-b6f2-834d94e8d009 with identifier: XJ76593
2026-03-30 12:21:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 85241851-e67a-5ea1-b6f2-834d94e8d009 with identifier: XJ76593 to the API
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:05:20Z',
'fuel_type': 'diesel',
'id': '85241851-e67a-5ea1-b6f2-834d94e8d009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ76593',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 304622,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-10',
'seller_name': None,
'title': 'BMW X5 xDrive 30d Lounge Plus',
'transmission': 'automatic',
'trim': 'Lounge Plus',
'year': 2015}
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ76593%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [auto1.fr] INFO: Saving data for XJ76593: {'auction_closing_time': 1774969520.0, 'created_time': 1774299172.313418, 'last_price_update_time': 1774873266.578519}
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XJ76593') HTTP/1.1" 204 0
2026-03-30 12:21:06 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 12:21:06 [auto1.fr] INFO: Found listing with ID: YL76832
2026-03-30 12:21:06 [auto1.fr] INFO: Found listing with ID: DW24154
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW24154%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [auto1.fr] INFO: Scrape type for DW24154: 2
2026-03-30 12:21:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbfefcd4-f7f4-5fb7-b241-01e407790a6e with identifier: DW24154
2026-03-30 12:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbfefcd4-f7f4-5fb7-b241-01e407790a6e with scrape type 2
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbfefcd4-f7f4-5fb7-b241-01e407790a6e with scrape type 2
2026-03-30 12:21:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dbfefcd4-f7f4-5fb7-b241-01e407790a6e, identifier: DW24154
2026-03-30 12:21:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dbfefcd4-f7f4-5fb7-b241-01e407790a6e with identifier: DW24154
2026-03-30 12:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dbfefcd4-f7f4-5fb7-b241-01e407790a6e with identifier: DW24154
2026-03-30 12:21:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dbfefcd4-f7f4-5fb7-b241-01e407790a6e with identifier: DW24154 to the API
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:16:49Z',
'fuel_type': 'diesel',
'id': 'dbfefcd4-f7f4-5fb7-b241-01e407790a6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW24154',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 249685,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-27',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
'transmission': 'manual',
'trim': 'Premium L2',
'year': 2018}
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW24154%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [auto1.fr] INFO: Saving data for DW24154: {'auction_closing_time': 1774970209.0, 'created_time': 1773693563.558733, 'last_price_update_time': 1774873267.126074}
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW24154') HTTP/1.1" 204 0
2026-03-30 12:21:07 [auto1.fr] INFO: Found listing with ID: TS11881
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS11881%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [auto1.fr] INFO: Scrape type for TS11881: 1
2026-03-30 12:21:07 [auto1.fr] INFO: Found listing with ID: KL52041
2026-03-30 12:21:07 [auto1.fr] INFO: Found listing with ID: DE92084
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE92084%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [auto1.fr] INFO: Scrape type for DE92084: 2
2026-03-30 12:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with identifier: DE92084
2026-03-30 12:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with scrape type 2
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with scrape type 2
2026-03-30 12:21:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 41e8d9fd-1936-54c5-b28a-3b33ffa5564b, identifier: DE92084
2026-03-30 12:21:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with identifier: DE92084
2026-03-30 12:21:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with identifier: DE92084
2026-03-30 12:21:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 41e8d9fd-1936-54c5-b28a-3b33ffa5564b with identifier: DE92084 to the API
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:23:56Z',
'fuel_type': 'diesel',
'id': '41e8d9fd-1936-54c5-b28a-3b33ffa5564b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE92084',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 151975,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-08',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE92084%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [auto1.fr] INFO: Saving data for DE92084: {'auction_closing_time': 1774970636.0, 'created_time': 1773078103.476192, 'last_price_update_time': 1774873267.648223}
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE92084') HTTP/1.1" 204 0
2026-03-30 12:21:07 [auto1.fr] INFO: Found listing with ID: FN42145
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN42145%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [auto1.fr] INFO: Scrape type for FN42145: 2
2026-03-30 12:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15e715d2-7a39-5ddc-b251-2b56180a4807 with identifier: FN42145
2026-03-30 12:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15e715d2-7a39-5ddc-b251-2b56180a4807 with scrape type 2
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15e715d2-7a39-5ddc-b251-2b56180a4807 with scrape type 2
2026-03-30 12:21:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15e715d2-7a39-5ddc-b251-2b56180a4807, identifier: FN42145
2026-03-30 12:21:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15e715d2-7a39-5ddc-b251-2b56180a4807 with identifier: FN42145
2026-03-30 12:21:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15e715d2-7a39-5ddc-b251-2b56180a4807 with identifier: FN42145
2026-03-30 12:21:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15e715d2-7a39-5ddc-b251-2b56180a4807 with identifier: FN42145 to the API
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:31:55Z',
'fuel_type': 'petrol',
'id': '15e715d2-7a39-5ddc-b251-2b56180a4807',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN42145',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 115353,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-23',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN42145%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Saving data for FN42145: {'auction_closing_time': 1774971115.0, 'created_time': 1773335896.524851, 'last_price_update_time': 1774873268.113903}
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FN42145') HTTP/1.1" 204 0
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: PF51993
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: RP02187
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: YW96620
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: YB41895
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: SP91950
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: KF87989
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: MD52514
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD52514%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Scrape type for MD52514: 1
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: KA23831
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: ES52369
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES52369%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Scrape type for ES52369: 2
2026-03-30 12:21:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfef8187-c036-5963-ad95-207820b3cd36 with identifier: ES52369
2026-03-30 12:21:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfef8187-c036-5963-ad95-207820b3cd36 with scrape type 2
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfef8187-c036-5963-ad95-207820b3cd36 with scrape type 2
2026-03-30 12:21:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dfef8187-c036-5963-ad95-207820b3cd36, identifier: ES52369
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT71985> (referer: https://www.auto1.com/v1/car-details-view/MT71985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE73125> (referer: https://www.auto1.com/v1/car-details-view/GE73125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dfef8187-c036-5963-ad95-207820b3cd36 with identifier: ES52369
2026-03-30 12:21:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dfef8187-c036-5963-ad95-207820b3cd36 with identifier: ES52369
2026-03-30 12:21:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dfef8187-c036-5963-ad95-207820b3cd36 with identifier: ES52369 to the API
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:36:16Z',
'fuel_type': 'petrol',
'id': 'dfef8187-c036-5963-ad95-207820b3cd36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES52369',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 94658,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Renault Twingo 0.9 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2019}
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES52369%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Saving data for ES52369: {'auction_closing_time': 1774971376.0, 'created_time': 1773335164.748688, 'last_price_update_time': 1774873268.713678}
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ES52369') HTTP/1.1" 204 0
2026-03-30 12:21:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: NL28829
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: FS23281
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: YN72247
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: NP71394
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP71394%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Scrape type for NP71394: 1
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: KV16401
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: JN91782
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: GP12773
2026-03-30 12:21:08 [auto1.fr] INFO: Found listing with ID: CH14191
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH14191%27 HTTP/1.1" 200 None
2026-03-30 12:21:08 [auto1.fr] INFO: Scrape type for CH14191: 2
2026-03-30 12:21:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with identifier: CH14191
2026-03-30 12:21:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with scrape type 2
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with scrape type 2
2026-03-30 12:21:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61b66d5f-cc8e-58c2-9229-844f60ec9b0e, identifier: CH14191
2026-03-30 12:21:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with identifier: CH14191
2026-03-30 12:21:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with identifier: CH14191
2026-03-30 12:21:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61b66d5f-cc8e-58c2-9229-844f60ec9b0e with identifier: CH14191 to the API
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:19:05Z',
'fuel_type': 'diesel',
'id': '61b66d5f-cc8e-58c2-9229-844f60ec9b0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH14191',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 155906,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-24',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH14191%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [auto1.fr] INFO: Saving data for CH14191: {'auction_closing_time': 1774970345.0, 'created_time': 1773254940.180863, 'last_price_update_time': 1774873269.281081}
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH14191') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with identifier: MT71985
2026-03-30 12:21:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with scrape type 1
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_de2106124c09a542cc0585ef09f140af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_de2106124c09a542cc0585ef09f140af.jpg not downloaded yet
2026-03-30 12:21:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1461498e-7e46-5334-b61e-0f9269f6c0f8 with identifier: GE73125
2026-03-30 12:21:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1461498e-7e46-5334-b61e-0f9269f6c0f8 with scrape type 1
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_ff146d88b30524ff258a288be5fbf6f0.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ff146d88b30524ff258a288be5fbf6f0.png not downloaded yet
2026-03-30 12:21:09 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL11481%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [auto1.fr] INFO: Scrape type for JL11481: 1
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_95275932d7b25e8e223d690961fbafdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_95275932d7b25e8e223d690961fbafdf.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_c9fb82d5eca46a855008d225c3bf4c8c.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_c9fb82d5eca46a855008d225c3bf4c8c.png not downloaded yet
2026-03-30 12:21:09 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 12:21:09 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 12:21:09 [auto1.fr] INFO: Found listing with ID: LH28225
2026-03-30 12:21:09 [auto1.fr] INFO: Found listing with ID: PW51275
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_758f8a988fd108ea2eb86c66c0390451.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_758f8a988fd108ea2eb86c66c0390451.png not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_52fde5657520de0178b580983b410cf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_52fde5657520de0178b580983b410cf2.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png not downloaded yet
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_de2106124c09a542cc0585ef09f140af.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_a3d1760156860c0c7334de91db1c0ae1.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_a3d1760156860c0c7334de91db1c0ae1.png not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_a9362af157d16f9f610aa60bcc30a48e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_a9362af157d16f9f610aa60bcc30a48e.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_8288c35b0a45b184f237d502d00043e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_8288c35b0a45b184f237d502d00043e7.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_238974aa1045eb7e5345fff271c3a990.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_238974aa1045eb7e5345fff271c3a990.png not downloaded yet
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca244590>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_de2106124c09a542cc0585ef09f140af.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_de2106124c09a542cc0585ef09f140af.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_607bf83deba55c1a9fe0273233795bfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_607bf83deba55c1a9fe0273233795bfa.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_853835697cd4377a05ac0fedf7dfd7a9.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_853835697cd4377a05ac0fedf7dfd7a9.png not downloaded yet
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ff146d88b30524ff258a288be5fbf6f0.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_f26486698e30587c1bfbb7935089adef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_f26486698e30587c1bfbb7935089adef.jpg not downloaded yet
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_ab22712ee1dd1d0319604b3514c82da3.png%27 HTTP/1.1" 200 None
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ab22712ee1dd1d0319604b3514c82da3.png not downloaded yet
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:09 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:09 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca245710>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_0.png HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_ff146d88b30524ff258a288be5fbf6f0.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ff146d88b30524ff258a288be5fbf6f0.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ab22712ee1dd1d0319604b3514c82da3.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bc5d0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_3.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_853835697cd4377a05ac0fedf7dfd7a9.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f1fd0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_9.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_ab22712ee1dd1d0319604b3514c82da3.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ab22712ee1dd1d0319604b3514c82da3.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_f26486698e30587c1bfbb7935089adef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_238974aa1045eb7e5345fff271c3a990.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_607bf83deba55c1a9fe0273233795bfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab58790>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_8.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_853835697cd4377a05ac0fedf7dfd7a9.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_853835697cd4377a05ac0fedf7dfd7a9.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c3b90>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_f26486698e30587c1bfbb7935089adef.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_f26486698e30587c1bfbb7935089adef.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca265150>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_7.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_238974aa1045eb7e5345fff271c3a990.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_238974aa1045eb7e5345fff271c3a990.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d6090>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_607bf83deba55c1a9fe0273233795bfa.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_607bf83deba55c1a9fe0273233795bfa.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_8288c35b0a45b184f237d502d00043e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd12684d0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1eed90>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_6.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22e7d0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_8288c35b0a45b184f237d502d00043e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_8288c35b0a45b184f237d502d00043e7.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_a9362af157d16f9f610aa60bcc30a48e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR96034> (referer: https://www.auto1.com/v1/car-details-view/YR96034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_a3d1760156860c0c7334de91db1c0ae1.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_52fde5657520de0178b580983b410cf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2abed0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_5.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cf250>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_a9362af157d16f9f610aa60bcc30a48e.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_a9362af157d16f9f610aa60bcc30a48e.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with identifier: YR96034
2026-03-30 12:21:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with scrape type 1
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg not downloaded yet
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1a9750>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_4.png HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_a3d1760156860c0c7334de91db1c0ae1.png') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_a3d1760156860c0c7334de91db1c0ae1.png saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ce490>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_52fde5657520de0178b580983b410cf2.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_52fde5657520de0178b580983b410cf2.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_95275932d7b25e8e223d690961fbafdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_221374bbcf261040dff69508a1844bc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_221374bbcf261040dff69508a1844bc8.jpg not downloaded yet
2026-03-30 12:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_c9fb82d5eca46a855008d225c3bf4c8c.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg not downloaded yet
2026-03-30 12:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_758f8a988fd108ea2eb86c66c0390451.png> (referer: https://www.auto1.com/)
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f9150>
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg saved to cache
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca147950>
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg saved to cache
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_341a4446947eb97d4a346d560aa370a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_341a4446947eb97d4a346d560aa370a5.jpg not downloaded yet
2026-03-30 12:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg not downloaded yet
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bef50>
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F7d%252F7a7d7debfb7c4e3b65676b4788c2a8a2%252Fpa%252FMT71985_95275932d7b25e8e223d690961fbafdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_95275932d7b25e8e223d690961fbafdf.jpg saved to cache
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1
2026-03-30 12:21:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1, skipping ID generation
2026-03-30 12:21:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with scrape type 1
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 sending to next pipeline
2026-03-30 12:21:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1, identifier: MT71985
2026-03-30 12:21:11 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:11 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab8f350>
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_1.png HTTP/1.1" 201 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_c9fb82d5eca46a855008d225c3bf4c8c.png') HTTP/1.1" 204 0
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_c9fb82d5eca46a855008d225c3bf4c8c.png saved to cache
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with identifier: MT71985
2026-03-30 12:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with identifier: MT71985
2026-03-30 12:21:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2fd4a762-b187-58bb-a9ae-4930a7cc9bf1 with identifier: MT71985 to the API
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_95275932d7b25e8e223d690961fbafdf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:01:31Z',
'fuel_type': 'diesel',
'id': '2fd4a762-b187-58bb-a9ae-4930a7cc9bf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT71985',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 72304,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_de2106124c09a542cc0585ef09f140af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_95275932d7b25e8e223d690961fbafdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4a29fe4126d376f6c74dcfc4e15dab33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_52fde5657520de0178b580983b410cf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_4cade4cd5bda9656a09b1ec2ba851b27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_a9362af157d16f9f610aa60bcc30a48e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_8288c35b0a45b184f237d502d00043e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_07fe498dfff7dd1dd0458da41bad8bc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_607bf83deba55c1a9fe0273233795bfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd4a762-b187-58bb-a9ae-4930a7cc9bf1/2fd4a762-b187-58bb-a9ae-4930a7cc9bf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/7d/7a7d7debfb7c4e3b65676b4788c2a8a2/pa/MT71985_f26486698e30587c1bfbb7935089adef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-23',
'seats_number': 2,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2022}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT71985%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Saving data for MT71985: {'created_time': 1774873271.911217, 'last_price_update_time': 1774873271.911225, 'auction_closing_time': 1774969291.0}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT71985') HTTP/1.1" 204 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg not downloaded yet
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_221374bbcf261040dff69508a1844bc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:21:12 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:21:12 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:21:12 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:21:12 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16cd10>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_2.png HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F24%252Fae24f34a0f45f1244676872d0cfc0dc4%252Fpa%252FGE73125_758f8a988fd108ea2eb86c66c0390451.png') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_758f8a988fd108ea2eb86c66c0390451.png saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1461498e-7e46-5334-b61e-0f9269f6c0f8
2026-03-30 12:21:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1461498e-7e46-5334-b61e-0f9269f6c0f8, skipping ID generation
2026-03-30 12:21:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1461498e-7e46-5334-b61e-0f9269f6c0f8 with scrape type 1
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1461498e-7e46-5334-b61e-0f9269f6c0f8 sending to next pipeline
2026-03-30 12:21:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1461498e-7e46-5334-b61e-0f9269f6c0f8, identifier: GE73125
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ede90>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_a44876091269aa26e06243409a146929.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a44876091269aa26e06243409a146929.jpg not downloaded yet
2026-03-30 12:21:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1461498e-7e46-5334-b61e-0f9269f6c0f8 with identifier: GE73125
2026-03-30 12:21:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1461498e-7e46-5334-b61e-0f9269f6c0f8 with identifier: GE73125
2026-03-30 12:21:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1461498e-7e46-5334-b61e-0f9269f6c0f8 with identifier: GE73125 to the API
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_758f8a988fd108ea2eb86c66c0390451.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:32:58Z',
'fuel_type': 'petrol',
'id': '1461498e-7e46-5334-b61e-0f9269f6c0f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE73125',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 26635,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 556276,
'Height': 463,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ff146d88b30524ff258a288be5fbf6f0.png',
'Width': 622},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_c9fb82d5eca46a855008d225c3bf4c8c.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 530325,
'Height': 469,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_758f8a988fd108ea2eb86c66c0390451.png',
'Width': 618},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 679477,
'Height': 547,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_29d6615d0cf56ff0e8a2af3c319a9ab4.png',
'Width': 732},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 545141,
'Height': 460,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_a3d1760156860c0c7334de91db1c0ae1.png',
'Width': 619},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 545961,
'Height': 460,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_4c65a5272ced6a9ef57dc1a664f05f8d.png',
'Width': 609},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_fb1b6010d7b7f0bc235bbb9b6b542950.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_238974aa1045eb7e5345fff271c3a990.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 620970,
'Height': 546,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_853835697cd4377a05ac0fedf7dfd7a9.png',
'Width': 751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1461498e-7e46-5334-b61e-0f9269f6c0f8/1461498e-7e46-5334-b61e-0f9269f6c0f8_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgae/24/ae24f34a0f45f1244676872d0cfc0dc4/pa/GE73125_ab22712ee1dd1d0319604b3514c82da3.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE73125%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [auto1.fr] INFO: Saving data for GE73125: {'created_time': 1774873272.611304, 'last_price_update_time': 1774873272.611318, 'auction_closing_time': 1774971178.0}
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE73125') HTTP/1.1" 204 0
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_341a4446947eb97d4a346d560aa370a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg not downloaded yet
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcacf6410>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_221374bbcf261040dff69508a1844bc8.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_221374bbcf261040dff69508a1844bc8.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_588533410c2f58df6ace7ec0b928c10b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_588533410c2f58df6ace7ec0b928c10b.jpg not downloaded yet
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg not downloaded yet
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca146d50>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_341a4446947eb97d4a346d560aa370a5.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_341a4446947eb97d4a346d560aa370a5.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a44876091269aa26e06243409a146929.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_588533410c2f58df6ace7ec0b928c10b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc3310>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26c550>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_a44876091269aa26e06243409a146929.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a44876091269aa26e06243409a146929.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca144110>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_588533410c2f58df6ace7ec0b928c10b.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_588533410c2f58df6ace7ec0b928c10b.jpg saved to cache
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e52d0>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26f590>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab1be90>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f5910>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F1c%252F831cd4c836fa5afb71b279210f310bc5%252Fpa%252FYR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79
2026-03-30 12:21:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03ae37e9-ff96-5463-ba89-7f75b96fdb79, skipping ID generation
2026-03-30 12:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with scrape type 1
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03ae37e9-ff96-5463-ba89-7f75b96fdb79 sending to next pipeline
2026-03-30 12:21:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03ae37e9-ff96-5463-ba89-7f75b96fdb79, identifier: YR96034
2026-03-30 12:21:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with identifier: YR96034
2026-03-30 12:21:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with identifier: YR96034
2026-03-30 12:21:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03ae37e9-ff96-5463-ba89-7f75b96fdb79 with identifier: YR96034 to the API
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:51:21Z',
'fuel_type': 'petrol',
'id': '03ae37e9-ff96-5463-ba89-7f75b96fdb79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR96034',
'listing': 'auction',
'location': 'FR, Tradein',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 101008,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_6b30dcd8f589fde7912c7e703c8a2ca0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_221374bbcf261040dff69508a1844bc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_618f7ca668cc0a2a2dfc6c8282bd4b25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_341a4446947eb97d4a346d560aa370a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_e4b4ba7ed183cd0d6ab86c7f108c4e88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_2d7c52eed76e8dcd321dbffac9ba65aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a44876091269aa26e06243409a146929.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_7e8368788f736a6a09cf3a7bb139e1a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_588533410c2f58df6ace7ec0b928c10b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03ae37e9-ff96-5463-ba89-7f75b96fdb79/03ae37e9-ff96-5463-ba89-7f75b96fdb79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/1c/831cd4c836fa5afb71b279210f310bc5/pa/YR96034_a88f717cde428c32b0c8d10d5186e4c7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-16',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2020}
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR96034%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [auto1.fr] INFO: Saving data for YR96034: {'created_time': 1774873273.672647, 'last_price_update_time': 1774873273.67266, 'auction_closing_time': 1774972281.0}
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR96034') HTTP/1.1" 204 0
2026-03-30 12:21:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.491(s), this was the 4th time calling it.
2026-03-30 12:21:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 9.786075415801001 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN08846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX85984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN65079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS11881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2026-03-30 12:21:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.862(s), this was the 1st time calling it.
2026-03-30 12:21:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.41039489336159 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:21:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD52514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF93568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL11481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.989(s), this was the 1st time calling it.
2026-03-30 12:21:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.905733209828248 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN08846> (referer: https://www.auto1.com/v1/car-details-view/ZN08846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce38ec75-7514-5957-beec-6e9a1395a93a with identifier: ZN08846
2026-03-30 12:21:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce38ec75-7514-5957-beec-6e9a1395a93a with scrape type 1
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_cc44675c644685210c4b522a45b75337.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_cc44675c644685210c4b522a45b75337.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_26673e0475c31ff6c2409a28e707017f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_26673e0475c31ff6c2409a28e707017f.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg not downloaded yet
2026-03-30 12:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_26673e0475c31ff6c2409a28e707017f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_ec25b94e41446dd5fa32227037e2d665.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_ec25b94e41446dd5fa32227037e2d665.jpg not downloaded yet
2026-03-30 12:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_cc44675c644685210c4b522a45b75337.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg not downloaded yet
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg not downloaded yet
2026-03-30 12:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg not downloaded yet
2026-03-30 12:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_ec25b94e41446dd5fa32227037e2d665.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca199c50>
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_26673e0475c31ff6c2409a28e707017f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_26673e0475c31ff6c2409a28e707017f.jpg saved to cache
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca259c10>
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_cc44675c644685210c4b522a45b75337.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_cc44675c644685210c4b522a45b75337.jpg saved to cache
2026-03-30 12:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca157010>
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2616d0>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_ec25b94e41446dd5fa32227037e2d665.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_ec25b94e41446dd5fa32227037e2d665.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f7590>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca198350>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab22c90>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0ab8110>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e7c90>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab1b110>
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ff4%252Fb2f4c0a4d78ae07fdb864c2a49f77975%252Fpa%252FZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg saved to cache
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce38ec75-7514-5957-beec-6e9a1395a93a
2026-03-30 12:21:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce38ec75-7514-5957-beec-6e9a1395a93a, skipping ID generation
2026-03-30 12:21:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce38ec75-7514-5957-beec-6e9a1395a93a with scrape type 1
2026-03-30 12:21:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce38ec75-7514-5957-beec-6e9a1395a93a sending to next pipeline
2026-03-30 12:21:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce38ec75-7514-5957-beec-6e9a1395a93a, identifier: ZN08846
2026-03-30 12:21:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce38ec75-7514-5957-beec-6e9a1395a93a with identifier: ZN08846
2026-03-30 12:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce38ec75-7514-5957-beec-6e9a1395a93a with identifier: ZN08846
2026-03-30 12:21:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce38ec75-7514-5957-beec-6e9a1395a93a with identifier: ZN08846 to the API
2026-03-30 12:21:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:05:07Z',
'fuel_type': 'diesel',
'id': 'ce38ec75-7514-5957-beec-6e9a1395a93a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN08846',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 87016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_cc44675c644685210c4b522a45b75337.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_26673e0475c31ff6c2409a28e707017f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_4b06928cd27f6a8f9c9e44952c9c2022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_3aaddbcafd0ab5dd02d7a0e0a4e0fcfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_9a575b193f2ee0c08ab7372e5d2e666e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8736f3348f70e2ff697cd8b1a765e03b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_ec25b94e41446dd5fa32227037e2d665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_8c26bc3c7731862bc48eea73c6c492f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_6e2d5fc7299a732baf8114c0a34278a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce38ec75-7514-5957-beec-6e9a1395a93a/ce38ec75-7514-5957-beec-6e9a1395a93a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/f4/b2f4c0a4d78ae07fdb864c2a49f77975/pa/ZN08846_a18ff1b4f80bf96ff879ae5036c6e106.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2008}
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN08846%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [auto1.fr] INFO: Saving data for ZN08846: {'created_time': 1774873296.410723, 'last_price_update_time': 1774873296.410734, 'auction_closing_time': 1774969507.0}
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN08846') HTTP/1.1" 204 0
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX85984> (referer: https://www.auto1.com/v1/car-details-view/FX85984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with identifier: FX85984
2026-03-30 12:21:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with scrape type 1
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_04e04938b0f2745c6f817164c4c311d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_04e04938b0f2745c6f817164c4c311d0.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_ec5906f6122b5721c59e4266549f5ae7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_ec5906f6122b5721c59e4266549f5ae7.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_9a5192c19c9050453a91edd391f2cb95.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a5192c19c9050453a91edd391f2cb95.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8ab2db14e95a06985f117d164fbf5a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8ab2db14e95a06985f117d164fbf5a31.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8696304d1c581c258e5b6eeb85067990.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8696304d1c581c258e5b6eeb85067990.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg not downloaded yet
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_04e04938b0f2745c6f817164c4c311d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_56cede0179aaaef279e5864cc9ceab81.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_56cede0179aaaef279e5864cc9ceab81.jpg not downloaded yet
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_dac1fc7475ecb925444822ea4f025e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_dac1fc7475ecb925444822ea4f025e48.jpg not downloaded yet
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_ec5906f6122b5721c59e4266549f5ae7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg not downloaded yet
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca156350>
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_04e04938b0f2745c6f817164c4c311d0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_04e04938b0f2745c6f817164c4c311d0.jpg saved to cache
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_dac1fc7475ecb925444822ea4f025e48.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1559d0>
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg saved to cache
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca261d10>
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_ec5906f6122b5721c59e4266549f5ae7.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_ec5906f6122b5721c59e4266549f5ae7.jpg saved to cache
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f1b50>
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg saved to cache
2026-03-30 12:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a5192c19c9050453a91edd391f2cb95.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_56cede0179aaaef279e5864cc9ceab81.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cc510>
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922c5d0>
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_dac1fc7475ecb925444822ea4f025e48.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_dac1fc7475ecb925444822ea4f025e48.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8696304d1c581c258e5b6eeb85067990.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8ab2db14e95a06985f117d164fbf5a31.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca22f5d0>
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_9a5192c19c9050453a91edd391f2cb95.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a5192c19c9050453a91edd391f2cb95.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c1f10>
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_56cede0179aaaef279e5864cc9ceab81.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_56cede0179aaaef279e5864cc9ceab81.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12efd0>
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8696304d1c581c258e5b6eeb85067990.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8696304d1c581c258e5b6eeb85067990.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f7b50>
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fcb%252Fa2cbde3349467f0e2f7ea30520907180%252Fpa%252FFX85984_8ab2db14e95a06985f117d164fbf5a31.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8ab2db14e95a06985f117d164fbf5a31.jpg saved to cache
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4
2026-03-30 12:21:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4, skipping ID generation
2026-03-30 12:21:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with scrape type 1
2026-03-30 12:21:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 sending to next pipeline
2026-03-30 12:21:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4, identifier: FX85984
2026-03-30 12:21:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with identifier: FX85984
2026-03-30 12:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with identifier: FX85984
2026-03-30 12:21:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26c16dc5-7a2f-5c73-bc4b-299afa0c01b4 with identifier: FX85984 to the API
2026-03-30 12:21:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8ab2db14e95a06985f117d164fbf5a31.jpg>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:48:51Z',
'fuel_type': 'diesel',
'id': '26c16dc5-7a2f-5c73-bc4b-299afa0c01b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX85984',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Renault',
'model': 'Clio',
'odometer': 104212,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_04e04938b0f2745c6f817164c4c311d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8cbb25df45f86e0fb1752d04b0a6d60a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_ec5906f6122b5721c59e4266549f5ae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a5192c19c9050453a91edd391f2cb95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8ab2db14e95a06985f117d164fbf5a31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_8696304d1c581c258e5b6eeb85067990.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_9a87d1f89a366592beb7f9d9b1636fa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_56cede0179aaaef279e5864cc9ceab81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_dac1fc7475ecb925444822ea4f025e48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c16dc5-7a2f-5c73-bc4b-299afa0c01b4/26c16dc5-7a2f-5c73-bc4b-299afa0c01b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cb/a2cbde3349467f0e2f7ea30520907180/pa/FX85984_d0183b1bbb9dcf47273df2eb30284f22.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-25',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Air MediaNav',
'transmission': 'manual',
'trim': 'Air MediaNav',
'year': 2018}
2026-03-30 12:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX85984%27 HTTP/1.1" 200 None
2026-03-30 12:21:38 [auto1.fr] INFO: Saving data for FX85984: {'created_time': 1774873298.478795, 'last_price_update_time': 1774873298.478806, 'auction_closing_time': 1774972131.0}
2026-03-30 12:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX85984') HTTP/1.1" 204 0
2026-03-30 12:21:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP71394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:48 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 22 pages/min), scraped 168 items (at 17 items/min)
2026-03-30 12:21:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:21:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.167(s), this was the 1st time calling it.
2026-03-30 12:21:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.395438480492595 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL96735> (referer: https://www.auto1.com/v1/car-details-view/XL96735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91154c61-760f-569c-96fe-81a65650593c with identifier: XL96735
2026-03-30 12:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91154c61-760f-569c-96fe-81a65650593c with scrape type 1
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg not downloaded yet
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_44b0a7bf7677a51610c468a81de83364.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_44b0a7bf7677a51610c468a81de83364.jpg not downloaded yet
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg not downloaded yet
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg not downloaded yet
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg not downloaded yet
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg not downloaded yet
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_44b0a7bf7677a51610c468a81de83364.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f3990>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b2b50>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_44b0a7bf7677a51610c468a81de83364.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_44b0a7bf7677a51610c468a81de83364.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca261ad0>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a8590>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca157e50>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a6810>
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F9d%252Fcb9de6c2c52bd6a3dae94de7ee2b7c7d%252Fpa%252FXL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg saved to cache
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91154c61-760f-569c-96fe-81a65650593c
2026-03-30 12:22:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91154c61-760f-569c-96fe-81a65650593c, skipping ID generation
2026-03-30 12:22:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91154c61-760f-569c-96fe-81a65650593c with scrape type 1
2026-03-30 12:22:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91154c61-760f-569c-96fe-81a65650593c sending to next pipeline
2026-03-30 12:22:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91154c61-760f-569c-96fe-81a65650593c, identifier: XL96735
2026-03-30 12:22:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91154c61-760f-569c-96fe-81a65650593c with identifier: XL96735
2026-03-30 12:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91154c61-760f-569c-96fe-81a65650593c with identifier: XL96735
2026-03-30 12:22:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91154c61-760f-569c-96fe-81a65650593c with identifier: XL96735 to the API
2026-03-30 12:22:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:11:56Z',
'fuel_type': 'diesel',
'id': '91154c61-760f-569c-96fe-81a65650593c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL96735',
'listing': 'auction',
'location': 'FR, Saint-Maur-des-Fossés',
'make': 'Renault',
'model': 'Clio',
'odometer': 166900,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_411076d0eb13b8b5d6cceffbce2085e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_44b0a7bf7677a51610c468a81de83364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_350f542e13cc4ae2d56237d3f6aac37d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6b35d8bdb2643687a4ee5eab4a396035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_3f447d52c8445b76675fca59ce7c3fe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91154c61-760f-569c-96fe-81a65650593c/91154c61-760f-569c-96fe-81a65650593c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/9d/cb9de6c2c52bd6a3dae94de7ee2b7c7d/pa/XL96735_6a09248e48fcdd5ad66f94c8c21fa588.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Campus.com',
'transmission': 'manual',
'trim': 'Campus.com',
'year': 2010}
2026-03-30 12:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL96735%27 HTTP/1.1" 200 None
2026-03-30 12:22:36 [auto1.fr] INFO: Saving data for XL96735: {'created_time': 1774873356.119853, 'last_price_update_time': 1774873356.119867, 'auction_closing_time': 1774969916.0}
2026-03-30 12:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL96735') HTTP/1.1" 204 0
2026-03-30 12:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD52514> (referer: https://www.auto1.com/v1/car-details-view/MD52514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba582dc-3791-505c-a8e5-c338e0856114 with identifier: MD52514
2026-03-30 12:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba582dc-3791-505c-a8e5-c338e0856114 with scrape type 1
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ba582dc-3791-505c-a8e5-c338e0856114
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_f0f7d1ac18b54a61ffc3063152d2bcdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f0f7d1ac18b54a61ffc3063152d2bcdb.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_6ee335d9743061371638be22832225b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_6ee335d9743061371638be22832225b2.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_c2863e256fc1f5314c072661c8b6e1af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_c2863e256fc1f5314c072661c8b6e1af.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_a6fd088f8d5c6816b194c8e0863a64df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_a6fd088f8d5c6816b194c8e0863a64df.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_7778032fa09f28911c91f38e885bd72d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_7778032fa09f28911c91f38e885bd72d.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_322f14a55cdf1a9a5c2065ef80228374.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_322f14a55cdf1a9a5c2065ef80228374.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_f744da554dac220eb7485e68c8845fb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f744da554dac220eb7485e68c8845fb1.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_be840599b7331fada03a7266fb5ae964.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_be840599b7331fada03a7266fb5ae964.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_52ecc4106ae4b06e1a3f8669d8204cb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_52ecc4106ae4b06e1a3f8669d8204cb1.jpg already downloaded
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F6a%252F166aec1d1c0f9c295a780936ab1744e1%252Fpa%252FMD52514_78632282a3d98b8056dcc98fa2de8151.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_78632282a3d98b8056dcc98fa2de8151.jpg already downloaded
2026-03-30 12:22:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ba582dc-3791-505c-a8e5-c338e0856114, identifier: MD52514
2026-03-30 12:22:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ba582dc-3791-505c-a8e5-c338e0856114 with identifier: MD52514
2026-03-30 12:22:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ba582dc-3791-505c-a8e5-c338e0856114 with identifier: MD52514
2026-03-30 12:22:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ba582dc-3791-505c-a8e5-c338e0856114 with identifier: MD52514 to the API
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD52514>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:28:17Z',
'fuel_type': 'diesel',
'id': '4ba582dc-3791-505c-a8e5-c338e0856114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD52514',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Nissan',
'model': 'Juke',
'odometer': 145425,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f0f7d1ac18b54a61ffc3063152d2bcdb.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_6ee335d9743061371638be22832225b2.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_c2863e256fc1f5314c072661c8b6e1af.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_a6fd088f8d5c6816b194c8e0863a64df.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_7778032fa09f28911c91f38e885bd72d.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_322f14a55cdf1a9a5c2065ef80228374.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f744da554dac220eb7485e68c8845fb1.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_be840599b7331fada03a7266fb5ae964.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_52ecc4106ae4b06e1a3f8669d8204cb1.jpg',
'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_78632282a3d98b8056dcc98fa2de8151.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f0f7d1ac18b54a61ffc3063152d2bcdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_6ee335d9743061371638be22832225b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3063732,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_c2863e256fc1f5314c072661c8b6e1af.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_a6fd088f8d5c6816b194c8e0863a64df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_7778032fa09f28911c91f38e885bd72d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_322f14a55cdf1a9a5c2065ef80228374.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_f744da554dac220eb7485e68c8845fb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_be840599b7331fada03a7266fb5ae964.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_52ecc4106ae4b06e1a3f8669d8204cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba582dc-3791-505c-a8e5-c338e0856114/4ba582dc-3791-505c-a8e5-c338e0856114_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/6a/166aec1d1c0f9c295a780936ab1744e1/pa/MD52514_78632282a3d98b8056dcc98fa2de8151.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-02-29',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD52514%27 HTTP/1.1" 200 None
2026-03-30 12:22:39 [auto1.fr] INFO: Saving data for MD52514: {'created_time': 1774873359.848627, 'last_price_update_time': 1774873359.848637, 'auction_closing_time': 1774970897.0}
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MD52514') HTTP/1.1" 204 0
2026-03-30 12:22:48 [scrapy.extensions.logstats] INFO: Crawled 215 pages (at 2 pages/min), scraped 170 items (at 2 items/min)
2026-03-30 12:22:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS11881> (referer: https://www.auto1.com/v1/car-details-view/TS11881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dfcbddc-bd09-5279-b839-5befcfe06ef3 with identifier: TS11881
2026-03-30 12:22:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dfcbddc-bd09-5279-b839-5befcfe06ef3 with scrape type 1
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dfcbddc-bd09-5279-b839-5befcfe06ef3
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_c18fd9b682be53eef0f0ea60b6735ecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_c18fd9b682be53eef0f0ea60b6735ecf.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_5bfe165794a8bc207455781612f215ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_5bfe165794a8bc207455781612f215ef.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_545093347288fdaa2385ff970a7324ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_545093347288fdaa2385ff970a7324ff.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_dd884c8c3cda1fc308d787e153117aec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_dd884c8c3cda1fc308d787e153117aec.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_8c9c2f0f5fab5562295bb3960c492259.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_8c9c2f0f5fab5562295bb3960c492259.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_cf7e22203c6b3677f32d0b914c669038.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_cf7e22203c6b3677f32d0b914c669038.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_ef9abe70f7e72edd4c19dbaf579e2b4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_ef9abe70f7e72edd4c19dbaf579e2b4c.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_9f0d0f51627b09449419c9079e24d53b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_9f0d0f51627b09449419c9079e24d53b.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_3295541ccc98404bcc68377da0be013a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_3295541ccc98404bcc68377da0be013a.jpg already downloaded
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F7a%252F987a547a8125a92376381ec850748fd9%252Fpa%252FTS11881_4c1137c151d12bd693e867b613cb28bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_4c1137c151d12bd693e867b613cb28bc.jpg already downloaded
2026-03-30 12:22:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dfcbddc-bd09-5279-b839-5befcfe06ef3, identifier: TS11881
2026-03-30 12:22:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dfcbddc-bd09-5279-b839-5befcfe06ef3 with identifier: TS11881
2026-03-30 12:22:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dfcbddc-bd09-5279-b839-5befcfe06ef3 with identifier: TS11881
2026-03-30 12:22:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1dfcbddc-bd09-5279-b839-5befcfe06ef3 with identifier: TS11881 to the API
2026-03-30 12:22:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS11881>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:46:01Z',
'fuel_type': 'diesel',
'id': '1dfcbddc-bd09-5279-b839-5befcfe06ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS11881',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 93483,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_c18fd9b682be53eef0f0ea60b6735ecf.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_5bfe165794a8bc207455781612f215ef.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_545093347288fdaa2385ff970a7324ff.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_dd884c8c3cda1fc308d787e153117aec.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_8c9c2f0f5fab5562295bb3960c492259.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_cf7e22203c6b3677f32d0b914c669038.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_ef9abe70f7e72edd4c19dbaf579e2b4c.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_9f0d0f51627b09449419c9079e24d53b.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_3295541ccc98404bcc68377da0be013a.jpg',
'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_4c1137c151d12bd693e867b613cb28bc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_c18fd9b682be53eef0f0ea60b6735ecf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_5bfe165794a8bc207455781612f215ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2377712,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_545093347288fdaa2385ff970a7324ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_dd884c8c3cda1fc308d787e153117aec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_8c9c2f0f5fab5562295bb3960c492259.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_cf7e22203c6b3677f32d0b914c669038.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2275926,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_ef9abe70f7e72edd4c19dbaf579e2b4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_9f0d0f51627b09449419c9079e24d53b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_3295541ccc98404bcc68377da0be013a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfcbddc-bd09-5279-b839-5befcfe06ef3/1dfcbddc-bd09-5279-b839-5befcfe06ef3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/7a/987a547a8125a92376381ec850748fd9/pa/TS11881_4c1137c151d12bd693e867b613cb28bc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-21',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Club XL',
'transmission': 'manual',
'trim': 'Club XL',
'year': 2018}
2026-03-30 12:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS11881%27 HTTP/1.1" 200 None
2026-03-30 12:22:53 [auto1.fr] INFO: Saving data for TS11881: {'created_time': 1774873373.197623, 'last_price_update_time': 1774873373.197633, 'auction_closing_time': 1774971961.0}
2026-03-30 12:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TS11881') HTTP/1.1" 204 0
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL11481> (referer: https://www.auto1.com/v1/car-details-view/JL11481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ea6a4d-114c-5898-a1b3-4578c6105d24 with identifier: JL11481
2026-03-30 12:23:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ea6a4d-114c-5898-a1b3-4578c6105d24 with scrape type 1
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_ffbc9fdd6560799becc8296681a1110d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_ffbc9fdd6560799becc8296681a1110d.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_1361f33a5edefeca1677941043ddc5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_1361f33a5edefeca1677941043ddc5d6.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg not downloaded yet
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg not downloaded yet
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg not downloaded yet
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_790181a754745e56db11dabe0c4c468e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_790181a754745e56db11dabe0c4c468e.jpg not downloaded yet
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_1361f33a5edefeca1677941043ddc5d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_ffbc9fdd6560799becc8296681a1110d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg not downloaded yet
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca148290>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_790181a754745e56db11dabe0c4c468e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca247550>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0af3250>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_1361f33a5edefeca1677941043ddc5d6.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_1361f33a5edefeca1677941043ddc5d6.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ebc10>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_ffbc9fdd6560799becc8296681a1110d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_ffbc9fdd6560799becc8296681a1110d.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b2250>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b2190>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2513d0>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b9cd0>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_790181a754745e56db11dabe0c4c468e.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_790181a754745e56db11dabe0c4c468e.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b0950>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2270d0>
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F0a%252Fac0a3e5411920add7630d6a1e2630338%252Fpa%252FJL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg saved to cache
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7ea6a4d-114c-5898-a1b3-4578c6105d24
2026-03-30 12:23:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7ea6a4d-114c-5898-a1b3-4578c6105d24, skipping ID generation
2026-03-30 12:23:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ea6a4d-114c-5898-a1b3-4578c6105d24 with scrape type 1
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7ea6a4d-114c-5898-a1b3-4578c6105d24 sending to next pipeline
2026-03-30 12:23:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7ea6a4d-114c-5898-a1b3-4578c6105d24, identifier: JL11481
2026-03-30 12:23:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7ea6a4d-114c-5898-a1b3-4578c6105d24 with identifier: JL11481
2026-03-30 12:23:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7ea6a4d-114c-5898-a1b3-4578c6105d24 with identifier: JL11481
2026-03-30 12:23:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c7ea6a4d-114c-5898-a1b3-4578c6105d24 with identifier: JL11481 to the API
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:52:17Z',
'fuel_type': 'diesel',
'id': 'c7ea6a4d-114c-5898-a1b3-4578c6105d24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL11481',
'listing': 'auction',
'location': 'FR, Saint Herblain',
'make': 'Citroen',
'model': 'DS4',
'odometer': 238843,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_6ab824730e1dd42874cedb4f3b1d94a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_583fb438d00daf1b0feb9a546cf2f24e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_ffbc9fdd6560799becc8296681a1110d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_1361f33a5edefeca1677941043ddc5d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_8b0770d9d5e6bfc36764078f6a6d5550.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_4e526fba3e08fbd86568a8f7e750c3ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_735e30f2450f8ac4f689750ec4a3c7bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_006b9cb5809d0c083600e4f5c0d6457f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_790181a754745e56db11dabe0c4c468e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ea6a4d-114c-5898-a1b3-4578c6105d24/c7ea6a4d-114c-5898-a1b3-4578c6105d24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/0a/ac0a3e5411920add7630d6a1e2630338/pa/JL11481_5e6f9eb3cfba8676f1d66ecb12ec655a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS4 1.6 e-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2012}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL11481%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.fr] INFO: Saving data for JL11481: {'created_time': 1774873385.195916, 'last_price_update_time': 1774873385.195931, 'auction_closing_time': 1774972337.0}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL11481') HTTP/1.1" 204 0
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.948(s), this was the 1st time calling it.
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.956016994711059 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.950(s), this was the 1st time calling it.
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.150894975321232 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY97876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.249(s), this was the 1st time calling it.
2026-03-30 12:23:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7555793844602037 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV38404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY97876> (referer: https://www.auto1.com/v1/car-details-view/KY97876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f7b247-494e-5de3-947b-68fe6d9321b6 with identifier: KY97876
2026-03-30 12:23:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f7b247-494e-5de3-947b-68fe6d9321b6 with scrape type 1
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17f7b247-494e-5de3-947b-68fe6d9321b6
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_95b24b3054c62f40c4980fac8814f1ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_95b24b3054c62f40c4980fac8814f1ad.jpg already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_afbaba05dc001dd7b77445fb7689a0c3.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_afbaba05dc001dd7b77445fb7689a0c3.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_4f4ddfbf456b12220d2b073b34aa7240.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_4f4ddfbf456b12220d2b073b34aa7240.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_40b0aed5ded9416a2d14e4e06ca10f4e.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_40b0aed5ded9416a2d14e4e06ca10f4e.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_fbd21ecb1a23bca9aac07519baf9b2b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_fbd21ecb1a23bca9aac07519baf9b2b9.jpg already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_6c2c0307e11193266676d4ee30742810.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_6c2c0307e11193266676d4ee30742810.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_9e414910c61b34cc26781828576748a0.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_9e414910c61b34cc26781828576748a0.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_7c79c425b384fd5c132354e80dc04efd.png%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_7c79c425b384fd5c132354e80dc04efd.png already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_938b45dadd0582f66e7900a1ad7dc43d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_938b45dadd0582f66e7900a1ad7dc43d.jpg already downloaded
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd9%252F54d90190d294de8e79354071f8c563b1%252Fpa%252FKY97876_b533fefc2bdd8a28f5a69e5bb8581f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_b533fefc2bdd8a28f5a69e5bb8581f24.jpg already downloaded
2026-03-30 12:23:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17f7b247-494e-5de3-947b-68fe6d9321b6, identifier: KY97876
2026-03-30 12:23:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17f7b247-494e-5de3-947b-68fe6d9321b6 with identifier: KY97876
2026-03-30 12:23:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17f7b247-494e-5de3-947b-68fe6d9321b6 with identifier: KY97876
2026-03-30 12:23:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17f7b247-494e-5de3-947b-68fe6d9321b6 with identifier: KY97876 to the API
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY97876>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 158,
'expiration_date': '2026-03-31T15:57:16Z',
'fuel_type': 'petrol',
'id': '17f7b247-494e-5de3-947b-68fe6d9321b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY97876',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Renault',
'model': 'Captur',
'odometer': 90239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_95b24b3054c62f40c4980fac8814f1ad.jpg',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_afbaba05dc001dd7b77445fb7689a0c3.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_4f4ddfbf456b12220d2b073b34aa7240.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_40b0aed5ded9416a2d14e4e06ca10f4e.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_fbd21ecb1a23bca9aac07519baf9b2b9.jpg',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_6c2c0307e11193266676d4ee30742810.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_9e414910c61b34cc26781828576748a0.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_7c79c425b384fd5c132354e80dc04efd.png',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_938b45dadd0582f66e7900a1ad7dc43d.jpg',
'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_b533fefc2bdd8a28f5a69e5bb8581f24.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381312,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_95b24b3054c62f40c4980fac8814f1ad.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_afbaba05dc001dd7b77445fb7689a0c3.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_4f4ddfbf456b12220d2b073b34aa7240.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_40b0aed5ded9416a2d14e4e06ca10f4e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_fbd21ecb1a23bca9aac07519baf9b2b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_6c2c0307e11193266676d4ee30742810.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_9e414910c61b34cc26781828576748a0.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_7c79c425b384fd5c132354e80dc04efd.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_938b45dadd0582f66e7900a1ad7dc43d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7b247-494e-5de3-947b-68fe6d9321b6/17f7b247-494e-5de3-947b-68fe6d9321b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392851,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/img54/d9/54d90190d294de8e79354071f8c563b1/pa/KY97876_b533fefc2bdd8a28f5a69e5bb8581f24.jpg',
'Width': 1920}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2022}
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY97876%27 HTTP/1.1" 200 None
2026-03-30 12:23:36 [auto1.fr] INFO: Saving data for KY97876: {'created_time': 1774873416.12731, 'last_price_update_time': 1774873416.12732, 'auction_closing_time': 1774972636.0}
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY97876') HTTP/1.1" 204 0
2026-03-30 12:23:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.030(s), this was the 2nd time calling it.
2026-03-30 12:23:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.776206217176279 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:23:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.016(s), this was the 1st time calling it.
2026-03-30 12:23:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.472084848350198 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV38404> (referer: https://www.auto1.com/v1/car-details-view/RV38404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6673400-3061-5d1e-b1a6-d84f5bb93bed with identifier: RV38404
2026-03-30 12:23:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6673400-3061-5d1e-b1a6-d84f5bb93bed with scrape type 1
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_b161f46660db7f5b86276785cee1a29b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_b161f46660db7f5b86276785cee1a29b.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_92214da194fd58807968e6fa4102dd4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_92214da194fd58807968e6fa4102dd4f.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_228063a4a57f35613c210569c1fbb014.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_228063a4a57f35613c210569c1fbb014.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_161ea977f58222b2a56aca6893f1e5db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_161ea977f58222b2a56aca6893f1e5db.jpg not downloaded yet
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg not downloaded yet
2026-03-30 12:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_b161f46660db7f5b86276785cee1a29b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg not downloaded yet
2026-03-30 12:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_ef338fae01c41434a047853b11dbd6f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_ef338fae01c41434a047853b11dbd6f9.jpg not downloaded yet
2026-03-30 12:23:48 [scrapy.extensions.logstats] INFO: Crawled 223 pages (at 8 pages/min), scraped 173 items (at 3 items/min)
2026-03-30 12:23:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_e5c496b369b28cf8c2faee74d7da8777.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_e5c496b369b28cf8c2faee74d7da8777.jpg not downloaded yet
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bec50>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_b161f46660db7f5b86276785cee1a29b.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_b161f46660db7f5b86276785cee1a29b.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_92214da194fd58807968e6fa4102dd4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca146cd0>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_161ea977f58222b2a56aca6893f1e5db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca195450>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ea690>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_228063a4a57f35613c210569c1fbb014.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca19bf90>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_92214da194fd58807968e6fa4102dd4f.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_92214da194fd58807968e6fa4102dd4f.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca195750>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_161ea977f58222b2a56aca6893f1e5db.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_161ea977f58222b2a56aca6893f1e5db.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_e5c496b369b28cf8c2faee74d7da8777.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca198d10>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_228063a4a57f35613c210569c1fbb014.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_228063a4a57f35613c210569c1fbb014.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_ef338fae01c41434a047853b11dbd6f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca194490>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc4e50>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_e5c496b369b28cf8c2faee74d7da8777.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_e5c496b369b28cf8c2faee74d7da8777.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab5be10>
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Ff8%252F2cf8342a4b062accda06fbcd22e9d017%252Fpa%252FRV38404_ef338fae01c41434a047853b11dbd6f9.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_ef338fae01c41434a047853b11dbd6f9.jpg saved to cache
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6673400-3061-5d1e-b1a6-d84f5bb93bed
2026-03-30 12:23:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6673400-3061-5d1e-b1a6-d84f5bb93bed, skipping ID generation
2026-03-30 12:23:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6673400-3061-5d1e-b1a6-d84f5bb93bed with scrape type 1
2026-03-30 12:23:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6673400-3061-5d1e-b1a6-d84f5bb93bed sending to next pipeline
2026-03-30 12:23:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6673400-3061-5d1e-b1a6-d84f5bb93bed, identifier: RV38404
2026-03-30 12:23:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6673400-3061-5d1e-b1a6-d84f5bb93bed with identifier: RV38404
2026-03-30 12:23:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6673400-3061-5d1e-b1a6-d84f5bb93bed with identifier: RV38404
2026-03-30 12:23:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e6673400-3061-5d1e-b1a6-d84f5bb93bed with identifier: RV38404 to the API
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_ef338fae01c41434a047853b11dbd6f9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:46:49Z',
'fuel_type': 'diesel',
'id': 'e6673400-3061-5d1e-b1a6-d84f5bb93bed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV38404',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 108208,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_b161f46660db7f5b86276785cee1a29b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_72ff1c4e0a2ee5569bbe5cae339b78a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_26f718d56eb2c24cab7a0ee1170ea6bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_92214da194fd58807968e6fa4102dd4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_228063a4a57f35613c210569c1fbb014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_161ea977f58222b2a56aca6893f1e5db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_a9ac9b957cc7484a15e71af9967cedb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_540a9be91f3fb6c1e1118eb0d2037ad0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_ef338fae01c41434a047853b11dbd6f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6673400-3061-5d1e-b1a6-d84f5bb93bed/e6673400-3061-5d1e-b1a6-d84f5bb93bed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/f8/2cf8342a4b062accda06fbcd22e9d017/pa/RV38404_e5c496b369b28cf8c2faee74d7da8777.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-17',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Express Extra Série Spéciale',
'transmission': 'manual',
'trim': 'Express Extra Série Spéciale',
'year': 2019}
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV38404%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Saving data for RV38404: {'created_time': 1774873430.046832, 'last_price_update_time': 1774873430.04685, 'auction_closing_time': 1774972009.0}
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV38404') HTTP/1.1" 204 0
2026-03-30 12:23:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.201(s), this was the 2nd time calling it.
2026-03-30 12:23:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.435623918501862 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:24:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP71394> (referer: https://www.auto1.com/v1/car-details-view/NP71394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dafa0ea0-2c87-5e05-a0b6-d233e9224d9d with identifier: NP71394
2026-03-30 12:24:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dafa0ea0-2c87-5e05-a0b6-d233e9224d9d with scrape type 1
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dafa0ea0-2c87-5e05-a0b6-d233e9224d9d
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_ff31ef18897fa2b042fa8012ac78a9f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_ff31ef18897fa2b042fa8012ac78a9f0.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_0eacca9cf8dd510ee1580d84bc0996e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0eacca9cf8dd510ee1580d84bc0996e7.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_15494d2cd0d3270566ca63c64a9664e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_15494d2cd0d3270566ca63c64a9664e4.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_eb808950aba7b259de719739deccd53f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_eb808950aba7b259de719739deccd53f.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_829aa47d8514da2ed4f63972ba11a308.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_829aa47d8514da2ed4f63972ba11a308.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_0807d7b1a02fd02610f31a4ba4faef1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0807d7b1a02fd02610f31a4ba4faef1f.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_38abb90fe60af759551272c946114526.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_38abb90fe60af759551272c946114526.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_871560a1ec383a1bf28bb3ae2de1aa3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_871560a1ec383a1bf28bb3ae2de1aa3e.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_fa17b4613d72f9419edc60f95bea944f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_fa17b4613d72f9419edc60f95bea944f.jpg already downloaded
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fc5%252F4ec5a2f55f145e35585751f28fa677d3%252Fpa%252FNP71394_84fb8391f46677709b3761e6a8ee2241.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_84fb8391f46677709b3761e6a8ee2241.jpg already downloaded
2026-03-30 12:24:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dafa0ea0-2c87-5e05-a0b6-d233e9224d9d, identifier: NP71394
2026-03-30 12:24:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dafa0ea0-2c87-5e05-a0b6-d233e9224d9d with identifier: NP71394
2026-03-30 12:24:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dafa0ea0-2c87-5e05-a0b6-d233e9224d9d with identifier: NP71394
2026-03-30 12:24:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dafa0ea0-2c87-5e05-a0b6-d233e9224d9d with identifier: NP71394 to the API
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP71394>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:40:45Z',
'fuel_type': 'diesel',
'id': 'dafa0ea0-2c87-5e05-a0b6-d233e9224d9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP71394',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '3008',
'odometer': 120901,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_ff31ef18897fa2b042fa8012ac78a9f0.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0eacca9cf8dd510ee1580d84bc0996e7.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_15494d2cd0d3270566ca63c64a9664e4.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_eb808950aba7b259de719739deccd53f.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_829aa47d8514da2ed4f63972ba11a308.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0807d7b1a02fd02610f31a4ba4faef1f.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_38abb90fe60af759551272c946114526.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_871560a1ec383a1bf28bb3ae2de1aa3e.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_fa17b4613d72f9419edc60f95bea944f.jpg',
'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_84fb8391f46677709b3761e6a8ee2241.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_ff31ef18897fa2b042fa8012ac78a9f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0eacca9cf8dd510ee1580d84bc0996e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_15494d2cd0d3270566ca63c64a9664e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_eb808950aba7b259de719739deccd53f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_829aa47d8514da2ed4f63972ba11a308.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_0807d7b1a02fd02610f31a4ba4faef1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_38abb90fe60af759551272c946114526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_871560a1ec383a1bf28bb3ae2de1aa3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_fa17b4613d72f9419edc60f95bea944f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafa0ea0-2c87-5e05-a0b6-d233e9224d9d/dafa0ea0-2c87-5e05-a0b6-d233e9224d9d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5a2f55f145e35585751f28fa677d3/pa/NP71394_84fb8391f46677709b3761e6a8ee2241.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 e-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2013}
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP71394%27 HTTP/1.1" 200 None
2026-03-30 12:24:09 [auto1.fr] INFO: Saving data for NP71394: {'created_time': 1774873449.976313, 'last_price_update_time': 1774873449.976328, 'auction_closing_time': 1774971645.0}
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP71394') HTTP/1.1" 204 0
2026-03-30 12:24:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.805(s), this was the 1st time calling it.
2026-03-30 12:24:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.3622376576984 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:24:48 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at -1 pages/min), scraped 175 items (at 2 items/min)
2026-03-30 12:24:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:24:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN65079> (referer: https://www.auto1.com/v1/car-details-view/BN65079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ed4765-fdeb-5375-ab5a-a2ef9865733b with identifier: BN65079
2026-03-30 12:24:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b with scrape type 1
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_963abb752d45e6f84103bb595f4e021a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_963abb752d45e6f84103bb595f4e021a.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_6c48613c71f18f081559113334e29d49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_6c48613c71f18f081559113334e29d49.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_dbc4c3ee1ea705508098c47b864f6206.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_dbc4c3ee1ea705508098c47b864f6206.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_0eb1c00234b369ca1a9278d3a2519296.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_0eb1c00234b369ca1a9278d3a2519296.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_c97da5e0e141707dcf1a881aa473275a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_c97da5e0e141707dcf1a881aa473275a.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_4c2f7c514e342868ec93b6864efafe27.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_4c2f7c514e342868ec93b6864efafe27.jpg not downloaded yet
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg not downloaded yet
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_6c48613c71f18f081559113334e29d49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_963abb752d45e6f84103bb595f4e021a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_4c2f7c514e342868ec93b6864efafe27.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_c97da5e0e141707dcf1a881aa473275a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d13d0>
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_6c48613c71f18f081559113334e29d49.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_6c48613c71f18f081559113334e29d49.jpg saved to cache
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca101a50>
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg saved to cache
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24d350>
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg saved to cache
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9b850>
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_963abb752d45e6f84103bb595f4e021a.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_963abb752d45e6f84103bb595f4e021a.jpg saved to cache
2026-03-30 12:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca24dc10>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_4c2f7c514e342868ec93b6864efafe27.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_4c2f7c514e342868ec93b6864efafe27.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca25b490>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_dbc4c3ee1ea705508098c47b864f6206.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f3cd0>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_0eb1c00234b369ca1a9278d3a2519296.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca244690>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_c97da5e0e141707dcf1a881aa473275a.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_c97da5e0e141707dcf1a881aa473275a.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922da50>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_dbc4c3ee1ea705508098c47b864f6206.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_dbc4c3ee1ea705508098c47b864f6206.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f1f10>
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F98%252Fc798fe709618618b51314b4e11d2e2fa%252Fpa%252FBN65079_0eb1c00234b369ca1a9278d3a2519296.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_0eb1c00234b369ca1a9278d3a2519296.jpg saved to cache
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b
2026-03-30 12:24:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66ed4765-fdeb-5375-ab5a-a2ef9865733b, skipping ID generation
2026-03-30 12:24:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b with scrape type 1
2026-03-30 12:24:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66ed4765-fdeb-5375-ab5a-a2ef9865733b sending to next pipeline
2026-03-30 12:24:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66ed4765-fdeb-5375-ab5a-a2ef9865733b, identifier: BN65079
2026-03-30 12:24:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66ed4765-fdeb-5375-ab5a-a2ef9865733b with identifier: BN65079
2026-03-30 12:24:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66ed4765-fdeb-5375-ab5a-a2ef9865733b with identifier: BN65079
2026-03-30 12:24:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66ed4765-fdeb-5375-ab5a-a2ef9865733b with identifier: BN65079 to the API
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_0eb1c00234b369ca1a9278d3a2519296.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:47:38Z',
'fuel_type': 'diesel',
'id': '66ed4765-fdeb-5375-ab5a-a2ef9865733b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN65079',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 249617,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_963abb752d45e6f84103bb595f4e021a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_6c48613c71f18f081559113334e29d49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_ba3054648ca19ac997dfeae17d6dbb88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_dbc4c3ee1ea705508098c47b864f6206.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_53ffb20a03c6ee1bf96d0a84f4ff7676.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_0eb1c00234b369ca1a9278d3a2519296.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_c97da5e0e141707dcf1a881aa473275a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_32ff6c7f5677b623a601a5c7e89e29c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_4c2f7c514e342868ec93b6864efafe27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ed4765-fdeb-5375-ab5a-a2ef9865733b/66ed4765-fdeb-5375-ab5a-a2ef9865733b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/98/c798fe709618618b51314b4e11d2e2fa/pa/BN65079_f3d7ce7a11912fc8aa80c8ec708cb6b2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2016}
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN65079%27 HTTP/1.1" 200 None
2026-03-30 12:24:59 [auto1.fr] INFO: Saving data for BN65079: {'created_time': 1774873499.721704, 'last_price_update_time': 1774873499.721715, 'auction_closing_time': 1774972058.0}
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BN65079') HTTP/1.1" 204 0
2026-03-30 12:25:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ70488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF93568> (referer: https://www.auto1.com/v1/car-details-view/GF93568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c2686f-3f3f-52f5-823d-129df73be54e with identifier: GF93568
2026-03-30 12:25:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c2686f-3f3f-52f5-823d-129df73be54e with scrape type 1
2026-03-30 12:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7c2686f-3f3f-52f5-823d-129df73be54e
2026-03-30 12:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_338c05615083c9b27ac8dfdcc693f7d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_338c05615083c9b27ac8dfdcc693f7d2.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_483802515432a03583f82e41cdf9f153.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_483802515432a03583f82e41cdf9f153.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_a89879fdbc42e97c78da35b3a8181c90.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a89879fdbc42e97c78da35b3a8181c90.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_f92942226150bc15c88cef2781ab3191.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_f92942226150bc15c88cef2781ab3191.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_d527938ce4aca492620f51e1dfd796c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d527938ce4aca492620f51e1dfd796c6.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_fc37b99b2ee6a88e908bb67b285f0908.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_fc37b99b2ee6a88e908bb67b285f0908.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_d8d45289ae6e70f5b7dcc6043966c043.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d8d45289ae6e70f5b7dcc6043966c043.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_a3e5f53b4da21f74e8e456a3e00d47ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a3e5f53b4da21f74e8e456a3e00d47ba.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_01b41f652a17d132e79750db0510ae51.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_01b41f652a17d132e79750db0510ae51.jpg already downloaded
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Faa%252Ff1aa952ebbfa737ee4867372662309d0%252Fpa%252FGF93568_c4a0cf234460e68b443b489f9362e1c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_c4a0cf234460e68b443b489f9362e1c7.jpg already downloaded
2026-03-30 12:25:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7c2686f-3f3f-52f5-823d-129df73be54e, identifier: GF93568
2026-03-30 12:25:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7c2686f-3f3f-52f5-823d-129df73be54e with identifier: GF93568
2026-03-30 12:25:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7c2686f-3f3f-52f5-823d-129df73be54e with identifier: GF93568
2026-03-30 12:25:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7c2686f-3f3f-52f5-823d-129df73be54e with identifier: GF93568 to the API
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF93568>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:12:28Z',
'fuel_type': 'diesel',
'id': 'a7c2686f-3f3f-52f5-823d-129df73be54e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF93568',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Volvo',
'model': 'XC90',
'odometer': 216294,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_338c05615083c9b27ac8dfdcc693f7d2.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_483802515432a03583f82e41cdf9f153.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a89879fdbc42e97c78da35b3a8181c90.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_f92942226150bc15c88cef2781ab3191.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d527938ce4aca492620f51e1dfd796c6.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_fc37b99b2ee6a88e908bb67b285f0908.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d8d45289ae6e70f5b7dcc6043966c043.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a3e5f53b4da21f74e8e456a3e00d47ba.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_01b41f652a17d132e79750db0510ae51.jpg',
'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_c4a0cf234460e68b443b489f9362e1c7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_338c05615083c9b27ac8dfdcc693f7d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_483802515432a03583f82e41cdf9f153.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a89879fdbc42e97c78da35b3a8181c90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_f92942226150bc15c88cef2781ab3191.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2288289,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d527938ce4aca492620f51e1dfd796c6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_fc37b99b2ee6a88e908bb67b285f0908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2333927,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_d8d45289ae6e70f5b7dcc6043966c043.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_a3e5f53b4da21f74e8e456a3e00d47ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_01b41f652a17d132e79750db0510ae51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2686f-3f3f-52f5-823d-129df73be54e/a7c2686f-3f3f-52f5-823d-129df73be54e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/aa/f1aa952ebbfa737ee4867372662309d0/pa/GF93568_c4a0cf234460e68b443b489f9362e1c7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-08-30',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2015}
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93568%27 HTTP/1.1" 200 None
2026-03-30 12:25:11 [auto1.fr] INFO: Saving data for GF93568: {'created_time': 1774873511.643002, 'last_price_update_time': 1774873511.643013, 'auction_closing_time': 1774969948.0}
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF93568') HTTP/1.1" 204 0
2026-03-30 12:25:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ70488> (referer: https://www.auto1.com/v1/car-details-view/YJ70488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with identifier: YJ70488
2026-03-30 12:25:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with scrape type 1
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_1c319602b109866ea664dff2324b281d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1c319602b109866ea664dff2324b281d.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_1f7eea54299a4c70aee8d888af13af43.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1f7eea54299a4c70aee8d888af13af43.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg not downloaded yet
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg not downloaded yet
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg not downloaded yet
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg not downloaded yet
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1f7eea54299a4c70aee8d888af13af43.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc9225810>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca194750>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ee590>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_1f7eea54299a4c70aee8d888af13af43.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1f7eea54299a4c70aee8d888af13af43.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab9ea10>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1c319602b109866ea664dff2324b281d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2dfd50>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ee910>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1571d0>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15ca10>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg saved to cache
2026-03-30 12:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16e890>
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_1c319602b109866ea664dff2324b281d.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1c319602b109866ea664dff2324b281d.jpg saved to cache
2026-03-30 12:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16f2d0>
2026-03-30 12:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F41%252F0f413369269b70e710b5941aede2eec4%252Fpa%252FYJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg saved to cache
2026-03-30 12:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b
2026-03-30 12:25:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b, skipping ID generation
2026-03-30 12:25:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with scrape type 1
2026-03-30 12:25:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 399a0dc6-b0e3-5c24-be65-b2bda27dc02b sending to next pipeline
2026-03-30 12:25:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b, identifier: YJ70488
2026-03-30 12:25:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with identifier: YJ70488
2026-03-30 12:25:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with identifier: YJ70488
2026-03-30 12:25:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 399a0dc6-b0e3-5c24-be65-b2bda27dc02b with identifier: YJ70488 to the API
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:02:58Z',
'fuel_type': 'petrol',
'id': '399a0dc6-b0e3-5c24-be65-b2bda27dc02b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ70488',
'listing': 'auction',
'location': 'FR, Champniers',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 117517,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_4a5a4a00aecbb3a0a251481ba518f13a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_a520fb6ee9ba6051367525ecbeb6e114.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3052116,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_50a416a5070174a76c32c9fcdae7eca8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2829241,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1c319602b109866ea664dff2324b281d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_1f7eea54299a4c70aee8d888af13af43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_10eb7f1c6682525ad8ff96c738831ebe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3020657,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_0b67f8593ef2c955a998ff4e11ef3361.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2997533,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2667c5a83cf737be6ef06d0c994eed78.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_002bd862ce776e3fac9c8508ad4cdac1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399a0dc6-b0e3-5c24-be65-b2bda27dc02b/399a0dc6-b0e3-5c24-be65-b2bda27dc02b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/41/0f413369269b70e710b5941aede2eec4/pa/YJ70488_2e9b05ab7f3e3e59ba991e2e3ea2bafb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 Sensation',
'transmission': 'automatic',
'trim': 'Sensation',
'year': 2017}
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ70488%27 HTTP/1.1" 200 None
2026-03-30 12:25:17 [auto1.fr] INFO: Saving data for YJ70488: {'created_time': 1774873517.843691, 'last_price_update_time': 1774873517.843704, 'auction_closing_time': 1774969378.0}
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ70488') HTTP/1.1" 204 0
2026-03-30 12:25:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.113(s), this was the 2nd time calling it.
2026-03-30 12:25:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.759393228244882 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:44 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 5758 | hits on page: 40
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: KA23831
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: ES52369
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES52369%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.fr] INFO: Scrape type for ES52369: 0
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: NL28829
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: FS23281
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: YN72247
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: NP71394
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP71394%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.fr] INFO: Scrape type for NP71394: 0
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: KV16401
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: JN91782
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: GP12773
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: CH14191
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH14191%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.fr] INFO: Scrape type for CH14191: 0
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL11481%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.fr] INFO: Scrape type for JL11481: 0
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: LH28225
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: PW51275
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: YB91559
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: GE60554
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE60554%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.fr] INFO: Scrape type for GE60554: 1
2026-03-30 12:25:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: ZN76101
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: RU12813
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: CG93824
2026-03-30 12:25:44 [auto1.fr] INFO: Found listing with ID: FB52625
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB52625%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.fr] INFO: Scrape type for FB52625: 1
2026-03-30 12:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: RN59979
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: BW84332
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW84332%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.fr] INFO: Scrape type for BW84332: 2
2026-03-30 12:25:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0463e5-4196-5978-8b95-549f310a4f4c with identifier: BW84332
2026-03-30 12:25:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0463e5-4196-5978-8b95-549f310a4f4c with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0463e5-4196-5978-8b95-549f310a4f4c with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f0463e5-4196-5978-8b95-549f310a4f4c, identifier: BW84332
2026-03-30 12:25:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f0463e5-4196-5978-8b95-549f310a4f4c with identifier: BW84332
2026-03-30 12:25:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f0463e5-4196-5978-8b95-549f310a4f4c with identifier: BW84332
2026-03-30 12:25:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f0463e5-4196-5978-8b95-549f310a4f4c with identifier: BW84332 to the API
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:57:36Z',
'fuel_type': 'diesel',
'id': '7f0463e5-4196-5978-8b95-549f310a4f4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW84332',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 75398,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-05',
'seller_name': None,
'title': 'Fiat Ducato 2.3 Multijet L1H1 RS: 3000 mm',
'transmission': 'manual',
'trim': 'L1H1 RS: 3000 mm',
'year': 2020}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW84332%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.fr] INFO: Saving data for BW84332: {'auction_closing_time': 1774972656.0, 'created_time': 1774270267.554583, 'last_price_update_time': 1774873545.669905}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BW84332') HTTP/1.1" 204 0
2026-03-30 12:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: LP57691
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: HL77314
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: VL59917
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: BW58605
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: SP58903
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: GD64881
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: DS29137
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: AW56148
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56148%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.fr] INFO: Scrape type for AW56148: 1
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: TE60628
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: HX53685
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: FJ07726
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: TK65775
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: MY85947
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: VG52594
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: KH02703
2026-03-30 12:25:45 [auto1.fr] INFO: Found listing with ID: FG53432
2026-03-30 12:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:48 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 5 pages/min), scraped 179 items (at 4 items/min)
2026-03-30 12:25:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW56148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 403.250(s), this was the 3rd time calling it.
2026-03-30 12:25:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.949921956642536 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE60554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:04 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: FG53432
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: UE64879
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: WN89162
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: CB03535
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: KF51820
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: NP05223
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: ZW51272
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: AW82700
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: LF08088
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: RA43033
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA43033%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Scrape type for RA43033: 1
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: AT92425
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: GZ04122
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: DB27239
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: CG67141
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: BH16535
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: GS18413
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS18413%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Scrape type for GS18413: 1
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: JV34550
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: ER38330
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: FJ22244
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: LX65836
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: DP63747
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP63747%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Scrape type for DP63747: 1
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: ZG20237
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG20237%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Scrape type for ZG20237: 1
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: AW25296
2026-03-30 12:26:04 [auto1.fr] INFO: Found listing with ID: RY21816
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY21816%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Scrape type for RY21816: 2
2026-03-30 12:26:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with identifier: RY21816
2026-03-30 12:26:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with scrape type 2
2026-03-30 12:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with scrape type 2
2026-03-30 12:26:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0593230f-b86d-5d92-bc1b-f7ff753a38e7, identifier: RY21816
2026-03-30 12:26:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with identifier: RY21816
2026-03-30 12:26:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with identifier: RY21816
2026-03-30 12:26:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0593230f-b86d-5d92-bc1b-f7ff753a38e7 with identifier: RY21816 to the API
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-31T15:37:27Z',
'fuel_type': 'petrol',
'id': '0593230f-b86d-5d92-bc1b-f7ff753a38e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY21816',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 59416,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-22',
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Techno',
'transmission': 'automatic',
'trim': 'Techno',
'year': 2023}
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY21816%27 HTTP/1.1" 200 None
2026-03-30 12:26:04 [auto1.fr] INFO: Saving data for RY21816: {'auction_closing_time': 1774971447.0, 'created_time': 1774269665.792998, 'last_price_update_time': 1774873564.945564}
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY21816') HTTP/1.1" 204 0
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: VS89734
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS89734%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [auto1.fr] INFO: Scrape type for VS89734: 2
2026-03-30 12:26:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with identifier: VS89734
2026-03-30 12:26:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with scrape type 2
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with scrape type 2
2026-03-30 12:26:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c50be8c0-7f5d-5a6f-9612-73e62ab5ea88, identifier: VS89734
2026-03-30 12:26:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with identifier: VS89734
2026-03-30 12:26:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with identifier: VS89734
2026-03-30 12:26:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c50be8c0-7f5d-5a6f-9612-73e62ab5ea88 with identifier: VS89734 to the API
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:09:17Z',
'fuel_type': 'diesel',
'id': 'c50be8c0-7f5d-5a6f-9612-73e62ab5ea88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89734',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 137530,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-30',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2018}
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS89734%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [auto1.fr] INFO: Saving data for VS89734: {'auction_closing_time': 1774969757.0, 'created_time': 1773077746.651028, 'last_price_update_time': 1774873565.594928}
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS89734') HTTP/1.1" 204 0
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: EU27983
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: YG27140
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: FV30142
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: KF38228
2026-03-30 12:26:05 [auto1.fr] INFO: Found listing with ID: LT07555
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT07555%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [auto1.fr] INFO: Scrape type for LT07555: 2
2026-03-30 12:26:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9010eb37-7832-5da8-a28a-bb82560248d4 with identifier: LT07555
2026-03-30 12:26:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9010eb37-7832-5da8-a28a-bb82560248d4 with scrape type 2
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9010eb37-7832-5da8-a28a-bb82560248d4 with scrape type 2
2026-03-30 12:26:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9010eb37-7832-5da8-a28a-bb82560248d4, identifier: LT07555
2026-03-30 12:26:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9010eb37-7832-5da8-a28a-bb82560248d4 with identifier: LT07555
2026-03-30 12:26:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9010eb37-7832-5da8-a28a-bb82560248d4 with identifier: LT07555
2026-03-30 12:26:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9010eb37-7832-5da8-a28a-bb82560248d4 with identifier: LT07555 to the API
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:16:49Z',
'fuel_type': 'diesel',
'id': '9010eb37-7832-5da8-a28a-bb82560248d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT07555',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 214512,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-23',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2014}
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT07555%27 HTTP/1.1" 200 None
2026-03-30 12:26:06 [auto1.fr] INFO: Saving data for LT07555: {'auction_closing_time': 1774970209.0, 'created_time': 1773692869.379085, 'last_price_update_time': 1774873566.050428}
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT07555') HTTP/1.1" 204 0
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: GL54239
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: GC36158
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: YY74823
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: GP91478
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: NP08318
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: XC44786
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: BD89729
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD89729%27 HTTP/1.1" 200 None
2026-03-30 12:26:06 [auto1.fr] INFO: Scrape type for BD89729: 2
2026-03-30 12:26:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with identifier: BD89729
2026-03-30 12:26:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with scrape type 2
2026-03-30 12:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with scrape type 2
2026-03-30 12:26:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fafc9ae9-0928-53ef-9f69-6a79ea1eb75d, identifier: BD89729
2026-03-30 12:26:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with identifier: BD89729
2026-03-30 12:26:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with identifier: BD89729
2026-03-30 12:26:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fafc9ae9-0928-53ef-9f69-6a79ea1eb75d with identifier: BD89729 to the API
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:41:04Z',
'fuel_type': 'hybrid',
'id': 'fafc9ae9-0928-53ef-9f69-6a79ea1eb75d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD89729',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 140252,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-12',
'seller_name': None,
'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2022}
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD89729%27 HTTP/1.1" 200 None
2026-03-30 12:26:06 [auto1.fr] INFO: Saving data for BD89729: {'auction_closing_time': 1774971664.0, 'created_time': 1774624548.303287, 'last_price_update_time': 1774873566.506583}
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD89729') HTTP/1.1" 204 0
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: PV10866
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: MV42781
2026-03-30 12:26:06 [auto1.fr] INFO: Found listing with ID: WX31823
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:08 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: GD81242
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: DH43299
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: EE45752
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45752%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [auto1.fr] INFO: Scrape type for EE45752: 1
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: MN56014
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: DD87525
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: JR34366
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR34366%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [auto1.fr] INFO: Scrape type for JR34366: 1
2026-03-30 12:26:08 [auto1.fr] INFO: Found listing with ID: SC12809
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC12809%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [auto1.fr] INFO: Scrape type for SC12809: 2
2026-03-30 12:26:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87523d2e-8780-5547-b023-075d028593b7 with identifier: SC12809
2026-03-30 12:26:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87523d2e-8780-5547-b023-075d028593b7 with scrape type 2
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87523d2e-8780-5547-b023-075d028593b7 with scrape type 2
2026-03-30 12:26:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87523d2e-8780-5547-b023-075d028593b7, identifier: SC12809
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP63747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87523d2e-8780-5547-b023-075d028593b7 with identifier: SC12809
2026-03-30 12:26:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87523d2e-8780-5547-b023-075d028593b7 with identifier: SC12809
2026-03-30 12:26:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87523d2e-8780-5547-b023-075d028593b7 with identifier: SC12809 to the API
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:08:58Z',
'fuel_type': 'diesel',
'id': '87523d2e-8780-5547-b023-075d028593b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC12809',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 174762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC12809%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [auto1.fr] INFO: Saving data for SC12809: {'auction_closing_time': 1774969738.0, 'created_time': 1773692635.167359, 'last_price_update_time': 1774873569.749103}
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC12809') HTTP/1.1" 204 0
2026-03-30 12:26:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:09 [auto1.fr] INFO: Found listing with ID: EW99844
2026-03-30 12:26:09 [auto1.fr] INFO: Found listing with ID: AW44269
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW44269%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [auto1.fr] INFO: Scrape type for AW44269: 1
2026-03-30 12:26:09 [auto1.fr] INFO: Found listing with ID: KB70829
2026-03-30 12:26:09 [auto1.fr] INFO: Found listing with ID: VY12323
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY12323%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [auto1.fr] INFO: Scrape type for VY12323: 2
2026-03-30 12:26:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with identifier: VY12323
2026-03-30 12:26:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with scrape type 2
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with scrape type 2
2026-03-30 12:26:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71b9e8e5-0489-54f7-b1f6-04a280bc39c6, identifier: VY12323
2026-03-30 12:26:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with identifier: VY12323
2026-03-30 12:26:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with identifier: VY12323
2026-03-30 12:26:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71b9e8e5-0489-54f7-b1f6-04a280bc39c6 with identifier: VY12323 to the API
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:34:05Z',
'fuel_type': 'diesel',
'id': '71b9e8e5-0489-54f7-b1f6-04a280bc39c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY12323',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 280981,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-03',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY12323%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Saving data for VY12323: {'auction_closing_time': 1774971245.0, 'created_time': 1773075905.911069, 'last_price_update_time': 1774873570.214984}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY12323') HTTP/1.1" 204 0
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: JS02864
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: JE60275
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE60275%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Scrape type for JE60275: 1
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: TP56731
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: SL97840
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: UF15534
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF15534%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Scrape type for UF15534: 1
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: YT50077
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: NE75064
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: HL20031
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: MC54002
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: VX18119
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: GG26646
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG26646%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Scrape type for GG26646: 1
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: TL75170
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: EA77824
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: CT12703
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: SU76987
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: NU85772
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU85772%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Scrape type for NU85772: 1
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: TU91399
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: LE79705
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: VV72434
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: CH43264
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: CB36786
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: RX13312
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: DK51089
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: PB02514
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: JF13819
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: EC34278
2026-03-30 12:26:10 [auto1.fr] INFO: Found listing with ID: WF80383
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF80383%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Scrape type for WF80383: 2
2026-03-30 12:26:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b72f7d-1925-5a52-8746-27684aa11568 with identifier: WF80383
2026-03-30 12:26:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b72f7d-1925-5a52-8746-27684aa11568 with scrape type 2
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b72f7d-1925-5a52-8746-27684aa11568 with scrape type 2
2026-03-30 12:26:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60b72f7d-1925-5a52-8746-27684aa11568, identifier: WF80383
2026-03-30 12:26:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60b72f7d-1925-5a52-8746-27684aa11568 with identifier: WF80383
2026-03-30 12:26:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60b72f7d-1925-5a52-8746-27684aa11568 with identifier: WF80383
2026-03-30 12:26:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60b72f7d-1925-5a52-8746-27684aa11568 with identifier: WF80383 to the API
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:25:09Z',
'fuel_type': 'diesel',
'id': '60b72f7d-1925-5a52-8746-27684aa11568',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF80383',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 204139,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-24',
'seller_name': None,
'title': 'Opel Meriva 1.7 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2013}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF80383%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.fr] INFO: Saving data for WF80383: {'auction_closing_time': 1774970709.0, 'created_time': 1773761695.414238, 'last_price_update_time': 1774873570.951379}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WF80383') HTTP/1.1" 204 0
2026-03-30 12:26:11 [auto1.fr] INFO: Found listing with ID: SB53559
2026-03-30 12:26:11 [auto1.fr] INFO: Found listing with ID: GG43203
2026-03-30 12:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS18413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG20237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE45752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR34366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:48 [scrapy.extensions.logstats] INFO: Crawled 236 pages (at 9 pages/min), scraped 186 items (at 7 items/min)
2026-03-30 12:26:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW44269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP63747> (referer: https://www.auto1.com/v1/car-details-view/DP63747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e2d9e2-de37-5c0f-ae17-58dcc1790b17 with identifier: DP63747
2026-03-30 12:26:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e2d9e2-de37-5c0f-ae17-58dcc1790b17 with scrape type 1
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97e2d9e2-de37-5c0f-ae17-58dcc1790b17
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_ac061cccf2c4fefb11cb2a2329436202.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ac061cccf2c4fefb11cb2a2329436202.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_a63eb8a89b59d641097a549b319b1928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a63eb8a89b59d641097a549b319b1928.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_ad45628e7d325611acbaf4820fbd108e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ad45628e7d325611acbaf4820fbd108e.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_832fae914224435578a8761ef7130fa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_832fae914224435578a8761ef7130fa5.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_fc39d4a110125a747861e821eead85ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_fc39d4a110125a747861e821eead85ad.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_a7bb6a808e9fc4ffd3a38d3bab2c0716.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a7bb6a808e9fc4ffd3a38d3bab2c0716.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_4f2a374dacaaded21abdbfb3140ec87e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_4f2a374dacaaded21abdbfb3140ec87e.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_f90f4cf686c329835e9697d577e2b32b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_f90f4cf686c329835e9697d577e2b32b.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_882cf6a5131168290f75f426e46b62bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_882cf6a5131168290f75f426e46b62bf.jpg already downloaded
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9a%252F9d9a367002d8f976ccf56c7e56ab9538%252Fpa%252FDP63747_947c3966c574d791b6d980736eafc68f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_947c3966c574d791b6d980736eafc68f.jpg already downloaded
2026-03-30 12:26:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97e2d9e2-de37-5c0f-ae17-58dcc1790b17, identifier: DP63747
2026-03-30 12:26:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97e2d9e2-de37-5c0f-ae17-58dcc1790b17 with identifier: DP63747
2026-03-30 12:26:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97e2d9e2-de37-5c0f-ae17-58dcc1790b17 with identifier: DP63747
2026-03-30 12:26:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97e2d9e2-de37-5c0f-ae17-58dcc1790b17 with identifier: DP63747 to the API
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP63747>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 280,
'expiration_date': '2026-03-31T15:24:17Z',
'fuel_type': 'petrol',
'id': '97e2d9e2-de37-5c0f-ae17-58dcc1790b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP63747',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 119559,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ac061cccf2c4fefb11cb2a2329436202.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a63eb8a89b59d641097a549b319b1928.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ad45628e7d325611acbaf4820fbd108e.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_832fae914224435578a8761ef7130fa5.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_fc39d4a110125a747861e821eead85ad.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a7bb6a808e9fc4ffd3a38d3bab2c0716.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_4f2a374dacaaded21abdbfb3140ec87e.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_f90f4cf686c329835e9697d577e2b32b.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_882cf6a5131168290f75f426e46b62bf.jpg',
'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_947c3966c574d791b6d980736eafc68f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ac061cccf2c4fefb11cb2a2329436202.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a63eb8a89b59d641097a549b319b1928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_ad45628e7d325611acbaf4820fbd108e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_832fae914224435578a8761ef7130fa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_fc39d4a110125a747861e821eead85ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_a7bb6a808e9fc4ffd3a38d3bab2c0716.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_4f2a374dacaaded21abdbfb3140ec87e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_f90f4cf686c329835e9697d577e2b32b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_882cf6a5131168290f75f426e46b62bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e2d9e2-de37-5c0f-ae17-58dcc1790b17/97e2d9e2-de37-5c0f-ae17-58dcc1790b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9a/9d9a367002d8f976ccf56c7e56ab9538/pa/DP63747_947c3966c574d791b6d980736eafc68f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.0 Turbo Veloce',
'transmission': 'automatic',
'trim': 'Veloce',
'year': 2018}
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP63747%27 HTTP/1.1" 200 None
2026-03-30 12:26:58 [auto1.fr] INFO: Saving data for DP63747: {'created_time': 1774873618.81781, 'last_price_update_time': 1774873618.817823, 'auction_closing_time': 1774970657.0}
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP63747') HTTP/1.1" 204 0
2026-03-30 12:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE60275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF15534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU85772/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG26646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS18413> (referer: https://www.auto1.com/v1/car-details-view/GS18413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36 with identifier: GS18413
2026-03-30 12:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36 with scrape type 1
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_bde286ea4991334d1c8f370f651c90b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_bde286ea4991334d1c8f370f651c90b7.jpg already downloaded
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_c0aaea2d0e5c31c8633afbc09443f670.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c0aaea2d0e5c31c8633afbc09443f670.jpg already downloaded
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_e8a258fd2064b1126eabc660b1d33011.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_e8a258fd2064b1126eabc660b1d33011.jpg already downloaded
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_f52c74a101f4ddacd2753dfa2b3b0bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_f52c74a101f4ddacd2753dfa2b3b0bdc.jpg already downloaded
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_457102a9a610f7cfbaa0b59dac89abdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_457102a9a610f7cfbaa0b59dac89abdb.jpg already downloaded
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff2%252F16f292af82b90f06b52d68be548b323c%252Fpa%252FGS18413_c2f94331ac7cdba25f28151452344ffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c2f94331ac7cdba25f28151452344ffb.jpg already downloaded
2026-03-30 12:27:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36, identifier: GS18413
2026-03-30 12:27:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36 with identifier: GS18413
2026-03-30 12:27:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36 with identifier: GS18413
2026-03-30 12:27:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36 with identifier: GS18413 to the API
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GS18413>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.5L',
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:23:51Z',
'fuel_type': 'diesel',
'id': '85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS18413',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Renault',
'model': 'Clio',
'odometer': 154926,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_bde286ea4991334d1c8f370f651c90b7.jpg',
'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c0aaea2d0e5c31c8633afbc09443f670.jpg',
'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_e8a258fd2064b1126eabc660b1d33011.jpg',
'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_f52c74a101f4ddacd2753dfa2b3b0bdc.jpg',
'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_457102a9a610f7cfbaa0b59dac89abdb.jpg',
'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c2f94331ac7cdba25f28151452344ffb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_bde286ea4991334d1c8f370f651c90b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c0aaea2d0e5c31c8633afbc09443f670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_e8a258fd2064b1126eabc660b1d33011.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_f52c74a101f4ddacd2753dfa2b3b0bdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_457102a9a610f7cfbaa0b59dac89abdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36/85b61bbc-9ad2-5aaa-b3e8-a4d00e3d8e36_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/f2/16f292af82b90f06b52d68be548b323c/pa/GS18413_c2f94331ac7cdba25f28151452344ffb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2002}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS18413%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [auto1.fr] INFO: Saving data for GS18413: {'created_time': 1774873643.968887, 'last_price_update_time': 1774873643.968898, 'auction_closing_time': 1774970631.0}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS18413') HTTP/1.1" 204 0
2026-03-30 12:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE45752> (referer: https://www.auto1.com/v1/car-details-view/EE45752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with identifier: EE45752
2026-03-30 12:27:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with scrape type 1
2026-03-30 12:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_0f78ef7a27718aeff69f7a969794befb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_0f78ef7a27718aeff69f7a969794befb.jpg not downloaded yet
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_24f3bd132156a0be7496f5b63a140044.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_24f3bd132156a0be7496f5b63a140044.jpg not downloaded yet
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_96d9d678216e0766eb8055c263c94dce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_96d9d678216e0766eb8055c263c94dce.jpg not downloaded yet
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg not downloaded yet
2026-03-30 12:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg not downloaded yet
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_1a23e0df878591f4c59a9bd4966b96db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_1a23e0df878591f4c59a9bd4966b96db.jpg not downloaded yet
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_24f3bd132156a0be7496f5b63a140044.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_96d9d678216e0766eb8055c263c94dce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_0f78ef7a27718aeff69f7a969794befb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcacf5c10>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_24f3bd132156a0be7496f5b63a140044.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_24f3bd132156a0be7496f5b63a140044.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_1a23e0df878591f4c59a9bd4966b96db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1b1750>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_96d9d678216e0766eb8055c263c94dce.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_96d9d678216e0766eb8055c263c94dce.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac75fd0>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_0f78ef7a27718aeff69f7a969794befb.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_0f78ef7a27718aeff69f7a969794befb.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1aa290>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac76710>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_1a23e0df878591f4c59a9bd4966b96db.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_1a23e0df878591f4c59a9bd4966b96db.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e8d10>
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ff1%252Ff5f1afd3df8a49764718ab8ce79e957d%252Fpa%252FEE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg saved to cache
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb
2026-03-30 12:27:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb, skipping ID generation
2026-03-30 12:27:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with scrape type 1
2026-03-30 12:27:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb sending to next pipeline
2026-03-30 12:27:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb, identifier: EE45752
2026-03-30 12:27:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with identifier: EE45752
2026-03-30 12:27:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with identifier: EE45752
2026-03-30 12:27:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4a9efaa0-4c5e-537c-9101-b1a9b04aaceb with identifier: EE45752 to the API
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:09:00Z',
'fuel_type': 'petrol',
'id': '4a9efaa0-4c5e-537c-9101-b1a9b04aaceb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE45752',
'listing': 'auction',
'location': 'FR, Reims',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 98281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_0f78ef7a27718aeff69f7a969794befb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_24f3bd132156a0be7496f5b63a140044.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_96d9d678216e0766eb8055c263c94dce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_2d391d10d93a7dcc4a07252f8f0e2403.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_a7d8d5a5b8128d59cf1c150724acc512.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9efaa0-4c5e-537c-9101-b1a9b04aaceb/4a9efaa0-4c5e-537c-9101-b1a9b04aaceb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/f1/f5f1afd3df8a49764718ab8ce79e957d/pa/EE45752_1a23e0df878591f4c59a9bd4966b96db.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-13',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2011}
2026-03-30 12:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45752%27 HTTP/1.1" 200 None
2026-03-30 12:27:29 [auto1.fr] INFO: Saving data for EE45752: {'created_time': 1774873649.044464, 'last_price_update_time': 1774873649.044477, 'auction_closing_time': 1774969740.0}
2026-03-30 12:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE45752') HTTP/1.1" 204 0
2026-03-30 12:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG20237> (referer: https://www.auto1.com/v1/car-details-view/ZG20237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae817c4f-4f48-5855-9b4d-8080427d349d with identifier: ZG20237
2026-03-30 12:27:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae817c4f-4f48-5855-9b4d-8080427d349d with scrape type 1
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ae817c4f-4f48-5855-9b4d-8080427d349d
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_7e9c2dddac4998c004ed33020727119a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_7e9c2dddac4998c004ed33020727119a.jpg already downloaded
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_6e56387a9288db8d29175598c7befde7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_6e56387a9288db8d29175598c7befde7.jpg already downloaded
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_90271ef872935e51b0f7b3d3583ba744.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_90271ef872935e51b0f7b3d3583ba744.jpg already downloaded
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_d05158b29fcc104271748385092389ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_d05158b29fcc104271748385092389ea.jpg already downloaded
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_65bdb00f4ead9c919aafda10cbdcaca6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_65bdb00f4ead9c919aafda10cbdcaca6.jpg already downloaded
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F96%252Fed96a4c09b5ae0a20a94bc26db54263c%252Fpa%252FZG20237_cebeaf0305d978abfe75b7bdbd528cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_cebeaf0305d978abfe75b7bdbd528cde.jpg already downloaded
2026-03-30 12:27:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae817c4f-4f48-5855-9b4d-8080427d349d, identifier: ZG20237
2026-03-30 12:27:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae817c4f-4f48-5855-9b4d-8080427d349d with identifier: ZG20237
2026-03-30 12:27:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae817c4f-4f48-5855-9b4d-8080427d349d with identifier: ZG20237
2026-03-30 12:27:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae817c4f-4f48-5855-9b4d-8080427d349d with identifier: ZG20237 to the API
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG20237>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:16:43Z',
'fuel_type': 'diesel',
'id': 'ae817c4f-4f48-5855-9b4d-8080427d349d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG20237',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Citroen',
'model': 'DS3',
'odometer': 248430,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_7e9c2dddac4998c004ed33020727119a.jpg',
'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_6e56387a9288db8d29175598c7befde7.jpg',
'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_90271ef872935e51b0f7b3d3583ba744.jpg',
'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_d05158b29fcc104271748385092389ea.jpg',
'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_65bdb00f4ead9c919aafda10cbdcaca6.jpg',
'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_cebeaf0305d978abfe75b7bdbd528cde.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_7e9c2dddac4998c004ed33020727119a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_6e56387a9288db8d29175598c7befde7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_90271ef872935e51b0f7b3d3583ba744.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_d05158b29fcc104271748385092389ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_65bdb00f4ead9c919aafda10cbdcaca6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae817c4f-4f48-5855-9b4d-8080427d349d/ae817c4f-4f48-5855-9b4d-8080427d349d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/96/ed96a4c09b5ae0a20a94bc26db54263c/pa/ZG20237_cebeaf0305d978abfe75b7bdbd528cde.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.6 HDi SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2010}
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG20237%27 HTTP/1.1" 200 None
2026-03-30 12:27:39 [auto1.fr] INFO: Saving data for ZG20237: {'created_time': 1774873659.340369, 'last_price_update_time': 1774873659.34038, 'auction_closing_time': 1774970203.0}
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG20237') HTTP/1.1" 204 0
2026-03-30 12:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW44269> (referer: https://www.auto1.com/v1/car-details-view/AW44269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835affc8-c994-5ca1-8904-3f1483184196 with identifier: AW44269
2026-03-30 12:27:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835affc8-c994-5ca1-8904-3f1483184196 with scrape type 1
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_a751306efeb5adb117fd227e88d6c5ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_a751306efeb5adb117fd227e88d6c5ac.jpg not downloaded yet
2026-03-30 12:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg not downloaded yet
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_b1edf4916e0405220496816bcfc2f31f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1edf4916e0405220496816bcfc2f31f.jpg not downloaded yet
2026-03-30 12:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_a751306efeb5adb117fd227e88d6c5ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15d490>
2026-03-30 12:27:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1cb910>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1edf4916e0405220496816bcfc2f31f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab40fd0>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_a751306efeb5adb117fd227e88d6c5ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_a751306efeb5adb117fd227e88d6c5ac.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e1c50>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac65a10>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca105d90>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_b1edf4916e0405220496816bcfc2f31f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1edf4916e0405220496816bcfc2f31f.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ab6d0>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14bb10>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcaba57d0>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f21d0>
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F9d%252F429d47b5bc43fd6d62965cef4c40a029%252Fpa%252FAW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg saved to cache
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 835affc8-c994-5ca1-8904-3f1483184196
2026-03-30 12:27:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 835affc8-c994-5ca1-8904-3f1483184196, skipping ID generation
2026-03-30 12:27:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835affc8-c994-5ca1-8904-3f1483184196 with scrape type 1
2026-03-30 12:27:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 835affc8-c994-5ca1-8904-3f1483184196 sending to next pipeline
2026-03-30 12:27:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 835affc8-c994-5ca1-8904-3f1483184196, identifier: AW44269
2026-03-30 12:27:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 835affc8-c994-5ca1-8904-3f1483184196 with identifier: AW44269
2026-03-30 12:27:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 835affc8-c994-5ca1-8904-3f1483184196 with identifier: AW44269
2026-03-30 12:27:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 835affc8-c994-5ca1-8904-3f1483184196 with identifier: AW44269 to the API
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:52:09Z',
'fuel_type': 'diesel',
'id': '835affc8-c994-5ca1-8904-3f1483184196',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW44269',
'listing': 'auction',
'location': 'FR, Coudekerque-Branche',
'make': 'Peugeot',
'model': '2008',
'odometer': 192434,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_41b60abdaeb0ea6006fb57640c8b9744.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_13cc2ea41d147f63ac7acdb8de17a677.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_4fdb6010f6eab76eed409718bda4ba2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_829ce4c5c7dfb26b50ad7c9739c89ada.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_657028bf1b1d7a0dc7e04b81f4cfebcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_a751306efeb5adb117fd227e88d6c5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1ffef94b79adf3c92746bf10c6bb030.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_6b66aee85ecd5124f323d1c04c6d784f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_bf759cb2899c93e93d6a2e2293ff1623.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835affc8-c994-5ca1-8904-3f1483184196/835affc8-c994-5ca1-8904-3f1483184196_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/9d/429d47b5bc43fd6d62965cef4c40a029/pa/AW44269_b1edf4916e0405220496816bcfc2f31f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW44269%27 HTTP/1.1" 200 None
2026-03-30 12:27:41 [auto1.fr] INFO: Saving data for AW44269: {'created_time': 1774873661.91077, 'last_price_update_time': 1774873661.910781, 'auction_closing_time': 1774972329.0}
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW44269') HTTP/1.1" 204 0
2026-03-30 12:27:48 [scrapy.extensions.logstats] INFO: Crawled 246 pages (at 10 pages/min), scraped 191 items (at 5 items/min)
2026-03-30 12:27:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:27:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.460(s), this was the 1st time calling it.
2026-03-30 12:27:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.584312758728051 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE60275> (referer: https://www.auto1.com/v1/car-details-view/JE60275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f14485-d0d8-51e4-923e-09529603b81b with identifier: JE60275
2026-03-30 12:27:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f14485-d0d8-51e4-923e-09529603b81b with scrape type 1
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17f14485-d0d8-51e4-923e-09529603b81b
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_c24ba8b80cd8f04c8ee1954bea1a4672.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c24ba8b80cd8f04c8ee1954bea1a4672.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_3c44ea9e7c81f2bd717ba466cd3b24f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3c44ea9e7c81f2bd717ba466cd3b24f2.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_276e43cd1c791fdb447469841f0b6786.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_276e43cd1c791fdb447469841f0b6786.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_7cb548ba38f30503dc86ea676d500e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_7cb548ba38f30503dc86ea676d500e5f.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_ac148a236c91b0c0c509e2a3ed8f9259.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_ac148a236c91b0c0c509e2a3ed8f9259.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_62ae4b607dc6ffc956df99d443a3166f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_62ae4b607dc6ffc956df99d443a3166f.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_c0c537292d28bf7d30a65045ec161305.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c0c537292d28bf7d30a65045ec161305.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_20f5b7e08d82f9acfbece8d9133123ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_20f5b7e08d82f9acfbece8d9133123ac.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_615a20497152d37577406a6e6d0d37f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_615a20497152d37577406a6e6d0d37f9.jpg already downloaded
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F12%252F271252bbc10353cf5ea5230a845b0e72%252Fpa%252FJE60275_3ddff9184717e27c56039a8f2bb753cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3ddff9184717e27c56039a8f2bb753cf.jpg already downloaded
2026-03-30 12:27:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17f14485-d0d8-51e4-923e-09529603b81b, identifier: JE60275
2026-03-30 12:27:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17f14485-d0d8-51e4-923e-09529603b81b with identifier: JE60275
2026-03-30 12:27:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17f14485-d0d8-51e4-923e-09529603b81b with identifier: JE60275
2026-03-30 12:27:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17f14485-d0d8-51e4-923e-09529603b81b with identifier: JE60275 to the API
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE60275>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:15:44Z',
'fuel_type': 'diesel',
'id': '17f14485-d0d8-51e4-923e-09529603b81b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE60275',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 152837,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c24ba8b80cd8f04c8ee1954bea1a4672.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3c44ea9e7c81f2bd717ba466cd3b24f2.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_276e43cd1c791fdb447469841f0b6786.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_7cb548ba38f30503dc86ea676d500e5f.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_ac148a236c91b0c0c509e2a3ed8f9259.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_62ae4b607dc6ffc956df99d443a3166f.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c0c537292d28bf7d30a65045ec161305.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_20f5b7e08d82f9acfbece8d9133123ac.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_615a20497152d37577406a6e6d0d37f9.jpg',
'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3ddff9184717e27c56039a8f2bb753cf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c24ba8b80cd8f04c8ee1954bea1a4672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3c44ea9e7c81f2bd717ba466cd3b24f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_276e43cd1c791fdb447469841f0b6786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2454062,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_7cb548ba38f30503dc86ea676d500e5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2432368,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_ac148a236c91b0c0c509e2a3ed8f9259.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_62ae4b607dc6ffc956df99d443a3166f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_c0c537292d28bf7d30a65045ec161305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_20f5b7e08d82f9acfbece8d9133123ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_615a20497152d37577406a6e6d0d37f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f14485-d0d8-51e4-923e-09529603b81b/17f14485-d0d8-51e4-923e-09529603b81b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/12/271252bbc10353cf5ea5230a845b0e72/pa/JE60275_3ddff9184717e27c56039a8f2bb753cf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE60275%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Saving data for JE60275: {'created_time': 1774873679.845788, 'last_price_update_time': 1774873679.845798, 'auction_closing_time': 1774970144.0}
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE60275') HTTP/1.1" 204 0
2026-03-30 12:28:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF15534> (referer: https://www.auto1.com/v1/car-details-view/UF15534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653ae1ab-3d50-5171-a1fa-c180e7934468 with identifier: UF15534
2026-03-30 12:28:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653ae1ab-3d50-5171-a1fa-c180e7934468 with scrape type 1
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 653ae1ab-3d50-5171-a1fa-c180e7934468
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_6b061d88137fdbca7b3683f33e446ed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6b061d88137fdbca7b3683f33e446ed5.jpg already downloaded
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_6adb3eda1b0787f226d372f5e7e9b2ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6adb3eda1b0787f226d372f5e7e9b2ff.jpg already downloaded
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_08087181c9c7f7f055f7720652eed023.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_08087181c9c7f7f055f7720652eed023.jpg already downloaded
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_2736662d95648c81f479bacabde2985b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_2736662d95648c81f479bacabde2985b.jpg already downloaded
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_adfa99f33fd8e219184a31ecbb4d9d3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_adfa99f33fd8e219184a31ecbb4d9d3c.jpg already downloaded
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F17%252F6b1719d1daff06f51054de137930d3bf%252Fpa%252FUF15534_5f2263b5def988476d03d08d3635b1ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_5f2263b5def988476d03d08d3635b1ae.jpg already downloaded
2026-03-30 12:28:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 653ae1ab-3d50-5171-a1fa-c180e7934468, identifier: UF15534
2026-03-30 12:28:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 653ae1ab-3d50-5171-a1fa-c180e7934468 with identifier: UF15534
2026-03-30 12:28:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 653ae1ab-3d50-5171-a1fa-c180e7934468 with identifier: UF15534
2026-03-30 12:28:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 653ae1ab-3d50-5171-a1fa-c180e7934468 with identifier: UF15534 to the API
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UF15534>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:23Z',
'fuel_type': 'diesel',
'id': '653ae1ab-3d50-5171-a1fa-c180e7934468',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF15534',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 234293,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6b061d88137fdbca7b3683f33e446ed5.jpg',
'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6adb3eda1b0787f226d372f5e7e9b2ff.jpg',
'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_08087181c9c7f7f055f7720652eed023.jpg',
'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_2736662d95648c81f479bacabde2985b.jpg',
'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_adfa99f33fd8e219184a31ecbb4d9d3c.jpg',
'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_5f2263b5def988476d03d08d3635b1ae.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6b061d88137fdbca7b3683f33e446ed5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_6adb3eda1b0787f226d372f5e7e9b2ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_08087181c9c7f7f055f7720652eed023.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_2736662d95648c81f479bacabde2985b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_adfa99f33fd8e219184a31ecbb4d9d3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_653ae1ab-3d50-5171-a1fa-c180e7934468/653ae1ab-3d50-5171-a1fa-c180e7934468_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/17/6b1719d1daff06f51054de137930d3bf/pa/UF15534_5f2263b5def988476d03d08d3635b1ae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2008}
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF15534%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [auto1.fr] INFO: Saving data for UF15534: {'created_time': 1774873681.645082, 'last_price_update_time': 1774873681.645094, 'auction_closing_time': 1774971863.0}
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UF15534') HTTP/1.1" 204 0
2026-03-30 12:28:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB52625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.637(s), this was the 1st time calling it.
2026-03-30 12:28:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.235692614104387 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR34366> (referer: https://www.auto1.com/v1/car-details-view/JR34366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb126aa0-6101-54a0-94b0-33d9de3b6d71 with identifier: JR34366
2026-03-30 12:28:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb126aa0-6101-54a0-94b0-33d9de3b6d71 with scrape type 1
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb126aa0-6101-54a0-94b0-33d9de3b6d71
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_a24e4d89bafbf52aa4c16d680253b896.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_a24e4d89bafbf52aa4c16d680253b896.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_dad11acd19c7eb2f8b99cdb6bdaef870.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_dad11acd19c7eb2f8b99cdb6bdaef870.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_0da4319698b3edd90de5c796c82ca36d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_0da4319698b3edd90de5c796c82ca36d.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_e7ac72a26c45b0c8b6b5134157e028d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_e7ac72a26c45b0c8b6b5134157e028d3.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_22b95fb52a3927ad628de9f82726998a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_22b95fb52a3927ad628de9f82726998a.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_8a680157e8fc50e7f0d8d4d03d8cf84f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_8a680157e8fc50e7f0d8d4d03d8cf84f.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_be0a148adae0ce9731bf63abbda2c239.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_be0a148adae0ce9731bf63abbda2c239.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_b2dd6f55c02cba2eff1e9b0636959812.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_b2dd6f55c02cba2eff1e9b0636959812.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_91eedcbe9e7c900d8de76190bef5529b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_91eedcbe9e7c900d8de76190bef5529b.jpg already downloaded
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F8d%252F2f8df8ac873dafb46a804ee8d062f1a6%252Fpa%252FJR34366_4404161ef2abaa4d6653faabdb42a0b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_4404161ef2abaa4d6653faabdb42a0b9.jpg already downloaded
2026-03-30 12:28:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb126aa0-6101-54a0-94b0-33d9de3b6d71, identifier: JR34366
2026-03-30 12:28:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb126aa0-6101-54a0-94b0-33d9de3b6d71 with identifier: JR34366
2026-03-30 12:28:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb126aa0-6101-54a0-94b0-33d9de3b6d71 with identifier: JR34366
2026-03-30 12:28:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb126aa0-6101-54a0-94b0-33d9de3b6d71 with identifier: JR34366 to the API
2026-03-30 12:28:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR34366>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:51:39Z',
'fuel_type': 'diesel',
'id': 'bb126aa0-6101-54a0-94b0-33d9de3b6d71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR34366',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Audi',
'model': 'A4',
'odometer': 222333,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_a24e4d89bafbf52aa4c16d680253b896.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_dad11acd19c7eb2f8b99cdb6bdaef870.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_0da4319698b3edd90de5c796c82ca36d.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_e7ac72a26c45b0c8b6b5134157e028d3.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_22b95fb52a3927ad628de9f82726998a.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_8a680157e8fc50e7f0d8d4d03d8cf84f.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_be0a148adae0ce9731bf63abbda2c239.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_b2dd6f55c02cba2eff1e9b0636959812.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_91eedcbe9e7c900d8de76190bef5529b.jpg',
'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_4404161ef2abaa4d6653faabdb42a0b9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_a24e4d89bafbf52aa4c16d680253b896.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_dad11acd19c7eb2f8b99cdb6bdaef870.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_0da4319698b3edd90de5c796c82ca36d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_e7ac72a26c45b0c8b6b5134157e028d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2904937,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_22b95fb52a3927ad628de9f82726998a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_8a680157e8fc50e7f0d8d4d03d8cf84f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_be0a148adae0ce9731bf63abbda2c239.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3339621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_b2dd6f55c02cba2eff1e9b0636959812.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3198726,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_91eedcbe9e7c900d8de76190bef5529b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb126aa0-6101-54a0-94b0-33d9de3b6d71/bb126aa0-6101-54a0-94b0-33d9de3b6d71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/8d/2f8df8ac873dafb46a804ee8d062f1a6/pa/JR34366_4404161ef2abaa4d6653faabdb42a0b9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2011}
2026-03-30 12:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR34366%27 HTTP/1.1" 200 None
2026-03-30 12:28:06 [auto1.fr] INFO: Saving data for JR34366: {'created_time': 1774873686.041778, 'last_price_update_time': 1774873686.041789, 'auction_closing_time': 1774972299.0}
2026-03-30 12:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR34366') HTTP/1.1" 204 0
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG26646> (referer: https://www.auto1.com/v1/car-details-view/GG26646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6438f113-7712-5f22-85e1-22cdfc00c69d with identifier: GG26646
2026-03-30 12:28:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6438f113-7712-5f22-85e1-22cdfc00c69d with scrape type 1
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_3934a37d7a1e0f89541df7074a75becc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_3934a37d7a1e0f89541df7074a75becc.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_814e8bdf39fc065c2307c140c8f6050c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_814e8bdf39fc065c2307c140c8f6050c.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_49d52b246c382bc9f7b20b7290838343.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_49d52b246c382bc9f7b20b7290838343.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_040c684d4db07d7912610ac31e9b94a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_040c684d4db07d7912610ac31e9b94a8.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_4263d120ee48e79e572216672fdc6844.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_4263d120ee48e79e572216672fdc6844.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_86b70a18d6c2f8c108debe9821a81c40.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_86b70a18d6c2f8c108debe9821a81c40.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_f31edd9198de5b8a6443d94243578d16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_f31edd9198de5b8a6443d94243578d16.jpg not downloaded yet
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg not downloaded yet
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_49d52b246c382bc9f7b20b7290838343.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg not downloaded yet
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_3934a37d7a1e0f89541df7074a75becc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_040c684d4db07d7912610ac31e9b94a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_4263d120ee48e79e572216672fdc6844.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_814e8bdf39fc065c2307c140c8f6050c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca104050>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_49d52b246c382bc9f7b20b7290838343.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_49d52b246c382bc9f7b20b7290838343.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.443(s), this was the 1st time calling it.
2026-03-30 12:28:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.492470328072184 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab20890>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_3934a37d7a1e0f89541df7074a75becc.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_3934a37d7a1e0f89541df7074a75becc.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2c0490>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_040c684d4db07d7912610ac31e9b94a8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_040c684d4db07d7912610ac31e9b94a8.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca103310>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_4263d120ee48e79e572216672fdc6844.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_4263d120ee48e79e572216672fdc6844.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca10be10>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_814e8bdf39fc065c2307c140c8f6050c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_814e8bdf39fc065c2307c140c8f6050c.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0ae46d0>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_86b70a18d6c2f8c108debe9821a81c40.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_f31edd9198de5b8a6443d94243578d16.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca19a450>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2defd0>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg saved to cache
2026-03-30 12:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2d4ad0>
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_86b70a18d6c2f8c108debe9821a81c40.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_86b70a18d6c2f8c108debe9821a81c40.jpg saved to cache
2026-03-30 12:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e2390>
2026-03-30 12:28:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F1c%252F961ccbc57c4c8aa6b22ff7a3907694d6%252Fpa%252FGG26646_f31edd9198de5b8a6443d94243578d16.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_f31edd9198de5b8a6443d94243578d16.jpg saved to cache
2026-03-30 12:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6438f113-7712-5f22-85e1-22cdfc00c69d
2026-03-30 12:28:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6438f113-7712-5f22-85e1-22cdfc00c69d, skipping ID generation
2026-03-30 12:28:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6438f113-7712-5f22-85e1-22cdfc00c69d with scrape type 1
2026-03-30 12:28:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6438f113-7712-5f22-85e1-22cdfc00c69d sending to next pipeline
2026-03-30 12:28:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6438f113-7712-5f22-85e1-22cdfc00c69d, identifier: GG26646
2026-03-30 12:28:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6438f113-7712-5f22-85e1-22cdfc00c69d with identifier: GG26646
2026-03-30 12:28:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6438f113-7712-5f22-85e1-22cdfc00c69d with identifier: GG26646
2026-03-30 12:28:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6438f113-7712-5f22-85e1-22cdfc00c69d with identifier: GG26646 to the API
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_f31edd9198de5b8a6443d94243578d16.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:45:33Z',
'fuel_type': 'petrol',
'id': '6438f113-7712-5f22-85e1-22cdfc00c69d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG26646',
'listing': 'auction',
'location': 'FR, Compiègne',
'make': 'Peugeot',
'model': '3008',
'odometer': 141113,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_3934a37d7a1e0f89541df7074a75becc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_814e8bdf39fc065c2307c140c8f6050c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_49d52b246c382bc9f7b20b7290838343.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_040c684d4db07d7912610ac31e9b94a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_4263d120ee48e79e572216672fdc6844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_86b70a18d6c2f8c108debe9821a81c40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_bb02b0f9c6851d99dbc7c45d6095fd0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_f31edd9198de5b8a6443d94243578d16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_c7b29a1be596cbc1d3807bd7300b01f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6438f113-7712-5f22-85e1-22cdfc00c69d/6438f113-7712-5f22-85e1-22cdfc00c69d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/1c/961ccbc57c4c8aa6b22ff7a3907694d6/pa/GG26646_d3aa7778cde5bbefca7af8ba2f659b18.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG26646%27 HTTP/1.1" 200 None
2026-03-30 12:28:08 [auto1.fr] INFO: Saving data for GG26646: {'created_time': 1774873688.567829, 'last_price_update_time': 1774873688.567841, 'auction_closing_time': 1774971933.0}
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG26646') HTTP/1.1" 204 0
2026-03-30 12:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU85772> (referer: https://www.auto1.com/v1/car-details-view/NU85772/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c707fe4-b860-5854-a773-3d64fcdb8fbd with identifier: NU85772
2026-03-30 12:28:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c707fe4-b860-5854-a773-3d64fcdb8fbd with scrape type 1
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3c707fe4-b860-5854-a773-3d64fcdb8fbd
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_9cb3efa856c8dd83d75349c1a2acf2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_9cb3efa856c8dd83d75349c1a2acf2e6.jpg already downloaded
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_bbdde699b56a0c87b99006d7585a6b9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_bbdde699b56a0c87b99006d7585a6b9d.jpg already downloaded
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_414e99a3344c942729926021a9ab991e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_414e99a3344c942729926021a9ab991e.jpg already downloaded
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_7f806727cccc6f50d137d15fc9a8a9af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_7f806727cccc6f50d137d15fc9a8a9af.jpg already downloaded
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_e6f95323f3b28afc7c5287fe92b0a806.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_e6f95323f3b28afc7c5287fe92b0a806.jpg already downloaded
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F15%252F5715884de44cdb655d005b3a23d06dcf%252Fpa%252FNU85772_30ae264ac2433315b3e14de283fd301d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_30ae264ac2433315b3e14de283fd301d.jpg already downloaded
2026-03-30 12:28:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c707fe4-b860-5854-a773-3d64fcdb8fbd, identifier: NU85772
2026-03-30 12:28:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c707fe4-b860-5854-a773-3d64fcdb8fbd with identifier: NU85772
2026-03-30 12:28:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c707fe4-b860-5854-a773-3d64fcdb8fbd with identifier: NU85772
2026-03-30 12:28:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c707fe4-b860-5854-a773-3d64fcdb8fbd with identifier: NU85772 to the API
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU85772>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:51:10Z',
'fuel_type': 'diesel',
'id': '3c707fe4-b860-5854-a773-3d64fcdb8fbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU85772',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Opel',
'model': 'Insignia',
'odometer': 262832,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_9cb3efa856c8dd83d75349c1a2acf2e6.jpg',
'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_bbdde699b56a0c87b99006d7585a6b9d.jpg',
'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_414e99a3344c942729926021a9ab991e.jpg',
'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_7f806727cccc6f50d137d15fc9a8a9af.jpg',
'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_e6f95323f3b28afc7c5287fe92b0a806.jpg',
'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_30ae264ac2433315b3e14de283fd301d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_9cb3efa856c8dd83d75349c1a2acf2e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_bbdde699b56a0c87b99006d7585a6b9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_414e99a3344c942729926021a9ab991e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_7f806727cccc6f50d137d15fc9a8a9af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_e6f95323f3b28afc7c5287fe92b0a806.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c707fe4-b860-5854-a773-3d64fcdb8fbd/3c707fe4-b860-5854-a773-3d64fcdb8fbd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/15/5715884de44cdb655d005b3a23d06dcf/pa/NU85772_30ae264ac2433315b3e14de283fd301d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2010}
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU85772%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [auto1.fr] INFO: Saving data for NU85772: {'created_time': 1774873690.307179, 'last_price_update_time': 1774873690.307192, 'auction_closing_time': 1774972270.0}
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NU85772') HTTP/1.1" 204 0
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB52625> (referer: https://www.auto1.com/v1/car-details-view/FB52625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c83bc539-59ab-593d-9dfb-f789838aed79 with identifier: FB52625
2026-03-30 12:28:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c83bc539-59ab-593d-9dfb-f789838aed79 with scrape type 1
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6fb1695ae111289c533696fcd4881932.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fb1695ae111289c533696fcd4881932.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_1d686c679c819ae0d9c5131fa74be947.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_1d686c679c819ae0d9c5131fa74be947.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_fc7f21c40a867e455048952aaf26bae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_fc7f21c40a867e455048952aaf26bae8.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_80322858958a3bce369111e1f36fa6e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_80322858958a3bce369111e1f36fa6e3.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6db85ec9120fca731c697935ec712cc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6db85ec9120fca731c697935ec712cc9.jpg not downloaded yet
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_1d686c679c819ae0d9c5131fa74be947.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_868eb3c7211a7b6580917e022295f14d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_868eb3c7211a7b6580917e022295f14d.jpg not downloaded yet
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fb1695ae111289c533696fcd4881932.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_ee99badbe6860cc43d7b30779f3139aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_ee99badbe6860cc43d7b30779f3139aa.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg not downloaded yet
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca101090>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_1d686c679c819ae0d9c5131fa74be947.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_1d686c679c819ae0d9c5131fa74be947.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6db85ec9120fca731c697935ec712cc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_fc7f21c40a867e455048952aaf26bae8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca103450>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6fb1695ae111289c533696fcd4881932.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fb1695ae111289c533696fcd4881932.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_ee99badbe6860cc43d7b30779f3139aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_868eb3c7211a7b6580917e022295f14d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_80322858958a3bce369111e1f36fa6e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab1b710>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6db85ec9120fca731c697935ec712cc9.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6db85ec9120fca731c697935ec712cc9.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922e510>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_fc7f21c40a867e455048952aaf26bae8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_fc7f21c40a867e455048952aaf26bae8.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca26d150>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca253c50>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ce550>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_ee99badbe6860cc43d7b30779f3139aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_ee99badbe6860cc43d7b30779f3139aa.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca296650>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b7f50>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_868eb3c7211a7b6580917e022295f14d.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_868eb3c7211a7b6580917e022295f14d.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0af3450>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F16%252F9816ebd1083a09779fcb0490ef02fee2%252Fpa%252FFB52625_80322858958a3bce369111e1f36fa6e3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_80322858958a3bce369111e1f36fa6e3.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c83bc539-59ab-593d-9dfb-f789838aed79
2026-03-30 12:28:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c83bc539-59ab-593d-9dfb-f789838aed79, skipping ID generation
2026-03-30 12:28:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c83bc539-59ab-593d-9dfb-f789838aed79 with scrape type 1
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c83bc539-59ab-593d-9dfb-f789838aed79 sending to next pipeline
2026-03-30 12:28:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c83bc539-59ab-593d-9dfb-f789838aed79, identifier: FB52625
2026-03-30 12:28:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c83bc539-59ab-593d-9dfb-f789838aed79 with identifier: FB52625
2026-03-30 12:28:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c83bc539-59ab-593d-9dfb-f789838aed79 with identifier: FB52625
2026-03-30 12:28:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c83bc539-59ab-593d-9dfb-f789838aed79 with identifier: FB52625 to the API
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_80322858958a3bce369111e1f36fa6e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:14:39Z',
'fuel_type': 'petrol',
'id': 'c83bc539-59ab-593d-9dfb-f789838aed79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB52625',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '206',
'odometer': 128390,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fb1695ae111289c533696fcd4881932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_1d686c679c819ae0d9c5131fa74be947.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_fc7f21c40a867e455048952aaf26bae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_20dc6ee8d956dd5c14f8fbb178c77714.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_80322858958a3bce369111e1f36fa6e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6fcd70111e9e6cb5e2fbefe4a24595ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_6db85ec9120fca731c697935ec712cc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_868eb3c7211a7b6580917e022295f14d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_ee99badbe6860cc43d7b30779f3139aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83bc539-59ab-593d-9dfb-f789838aed79/c83bc539-59ab-593d-9dfb-f789838aed79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/16/9816ebd1083a09779fcb0490ef02fee2/pa/FB52625_e68a15dbb90fa8387d9e26118a5fa86d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 206 1.1 X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2002}
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB52625%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [auto1.fr] INFO: Saving data for FB52625: {'created_time': 1774873691.665609, 'last_price_update_time': 1774873691.665618, 'auction_closing_time': 1774970079.0}
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB52625') HTTP/1.1" 204 0
2026-03-30 12:28:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 538.458(s), this was the 4th time calling it.
2026-03-30 12:28:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.257787351183342 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.268(s), this was the 1st time calling it.
2026-03-30 12:28:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.444661502800485 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW56148> (referer: https://www.auto1.com/v1/car-details-view/AW56148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49072d5c-48da-543b-9ee8-b836ed6db8e4 with identifier: AW56148
2026-03-30 12:28:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49072d5c-48da-543b-9ee8-b836ed6db8e4 with scrape type 1
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_89c2fd4feccc29574fe43923e38e253b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_89c2fd4feccc29574fe43923e38e253b.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_ab791329797c52cc56e2b63831162582.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_ab791329797c52cc56e2b63831162582.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_65dcae3c0c2b722403b54f8d805f4406.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_65dcae3c0c2b722403b54f8d805f4406.jpg not downloaded yet
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_bb06069177c84815b551d2306451e978.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_bb06069177c84815b551d2306451e978.jpg not downloaded yet
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_ab791329797c52cc56e2b63831162582.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_c37c983237ad187d9ef920a38bf51f5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_c37c983237ad187d9ef920a38bf51f5f.jpg not downloaded yet
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_89c2fd4feccc29574fe43923e38e253b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac66650>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_c37c983237ad187d9ef920a38bf51f5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_65dcae3c0c2b722403b54f8d805f4406.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_bb06069177c84815b551d2306451e978.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13c410>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_ab791329797c52cc56e2b63831162582.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_ab791329797c52cc56e2b63831162582.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac66b50>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e1ed0>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab59410>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_89c2fd4feccc29574fe43923e38e253b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_89c2fd4feccc29574fe43923e38e253b.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca124bd0>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc3c50>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_c37c983237ad187d9ef920a38bf51f5f.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_c37c983237ad187d9ef920a38bf51f5f.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca100c90>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b6010>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_65dcae3c0c2b722403b54f8d805f4406.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_65dcae3c0c2b722403b54f8d805f4406.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab4a250>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0b%252Fea0ba631dee80b4f54c590d95c6246c9%252Fpa%252FAW56148_bb06069177c84815b551d2306451e978.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_bb06069177c84815b551d2306451e978.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49072d5c-48da-543b-9ee8-b836ed6db8e4
2026-03-30 12:28:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49072d5c-48da-543b-9ee8-b836ed6db8e4, skipping ID generation
2026-03-30 12:28:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49072d5c-48da-543b-9ee8-b836ed6db8e4 with scrape type 1
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49072d5c-48da-543b-9ee8-b836ed6db8e4 sending to next pipeline
2026-03-30 12:28:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 49072d5c-48da-543b-9ee8-b836ed6db8e4, identifier: AW56148
2026-03-30 12:28:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49072d5c-48da-543b-9ee8-b836ed6db8e4 with identifier: AW56148
2026-03-30 12:28:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49072d5c-48da-543b-9ee8-b836ed6db8e4 with identifier: AW56148
2026-03-30 12:28:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49072d5c-48da-543b-9ee8-b836ed6db8e4 with identifier: AW56148 to the API
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_bb06069177c84815b551d2306451e978.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:34:33Z',
'fuel_type': 'diesel',
'id': '49072d5c-48da-543b-9ee8-b836ed6db8e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW56148',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 137974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_84df9c20b6b662301e74c90ea8fdc20b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_89c2fd4feccc29574fe43923e38e253b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_ab791329797c52cc56e2b63831162582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_b83ddc811c5f14ae7aefb5ae58407c3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_f66dcab0ae0836fb21f7e5703fbb2a95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_7bf200e2bd6703bb7d4aaea7cdeaa6b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_65dcae3c0c2b722403b54f8d805f4406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_2addcbe1283fb0cae0db770d4aea42cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_bb06069177c84815b551d2306451e978.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49072d5c-48da-543b-9ee8-b836ed6db8e4/49072d5c-48da-543b-9ee8-b836ed6db8e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0b/ea0ba631dee80b4f54c590d95c6246c9/pa/AW56148_c37c983237ad187d9ef920a38bf51f5f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Yeti 2.0 TDI Monte Carlo',
'transmission': 'manual',
'trim': 'Monte Carlo',
'year': 2017}
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56148%27 HTTP/1.1" 200 None
2026-03-30 12:28:17 [auto1.fr] INFO: Saving data for AW56148: {'created_time': 1774873697.815653, 'last_price_update_time': 1774873697.815664, 'auction_closing_time': 1774971273.0}
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW56148') HTTP/1.1" 204 0
2026-03-30 12:28:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2026-03-30 12:28:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.066(s), this was the 1st time calling it.
2026-03-30 12:28:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.886914605378357 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE60554> (referer: https://www.auto1.com/v1/car-details-view/GE60554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170a62df-b85a-51cd-95b0-555fed14e4af with identifier: GE60554
2026-03-30 12:28:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170a62df-b85a-51cd-95b0-555fed14e4af with scrape type 1
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_c937c82ba84a7102200a3fa5d18569ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_c937c82ba84a7102200a3fa5d18569ff.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_af9c8e16a81560aef229d4ebe7865969.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_af9c8e16a81560aef229d4ebe7865969.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_586a31a357de96d9fef2fe0d90817c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_586a31a357de96d9fef2fe0d90817c96.jpg not downloaded yet
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_0ec278a4492d691e8143d3886ffaca9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0ec278a4492d691e8143d3886ffaca9c.jpg not downloaded yet
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_3b641955202b1816fa517a66ff058ddf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3b641955202b1816fa517a66ff058ddf.jpg not downloaded yet
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_c937c82ba84a7102200a3fa5d18569ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_ea1409762517a976311e78a50da1114b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_ea1409762517a976311e78a50da1114b.jpg not downloaded yet
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg not downloaded yet
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_0310cf2c01c5816998fc7e9060c68f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0310cf2c01c5816998fc7e9060c68f16.jpg not downloaded yet
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0310cf2c01c5816998fc7e9060c68f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3b641955202b1816fa517a66ff058ddf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16ddd0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16ed10>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_c937c82ba84a7102200a3fa5d18569ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_c937c82ba84a7102200a3fa5d18569ff.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_ea1409762517a976311e78a50da1114b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_af9c8e16a81560aef229d4ebe7865969.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_586a31a357de96d9fef2fe0d90817c96.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca11a050>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca10ac50>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_0310cf2c01c5816998fc7e9060c68f16.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0310cf2c01c5816998fc7e9060c68f16.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca267050>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_3b641955202b1816fa517a66ff058ddf.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3b641955202b1816fa517a66ff058ddf.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0ec278a4492d691e8143d3886ffaca9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca16ead0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b8a50>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_ea1409762517a976311e78a50da1114b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_ea1409762517a976311e78a50da1114b.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b41bd0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_af9c8e16a81560aef229d4ebe7865969.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_af9c8e16a81560aef229d4ebe7865969.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca126550>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_586a31a357de96d9fef2fe0d90817c96.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_586a31a357de96d9fef2fe0d90817c96.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca258c90>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30c8b36886be7325903040aecd9978%252Fpa%252FGE60554_0ec278a4492d691e8143d3886ffaca9c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0ec278a4492d691e8143d3886ffaca9c.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 170a62df-b85a-51cd-95b0-555fed14e4af
2026-03-30 12:28:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 170a62df-b85a-51cd-95b0-555fed14e4af, skipping ID generation
2026-03-30 12:28:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170a62df-b85a-51cd-95b0-555fed14e4af with scrape type 1
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 170a62df-b85a-51cd-95b0-555fed14e4af sending to next pipeline
2026-03-30 12:28:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 170a62df-b85a-51cd-95b0-555fed14e4af, identifier: GE60554
2026-03-30 12:28:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 170a62df-b85a-51cd-95b0-555fed14e4af with identifier: GE60554
2026-03-30 12:28:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 170a62df-b85a-51cd-95b0-555fed14e4af with identifier: GE60554
2026-03-30 12:28:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 170a62df-b85a-51cd-95b0-555fed14e4af with identifier: GE60554 to the API
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0ec278a4492d691e8143d3886ffaca9c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:27:41Z',
'fuel_type': 'petrol',
'id': '170a62df-b85a-51cd-95b0-555fed14e4af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE60554',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '308',
'odometer': 111022,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_b0b620a16a14dd6ccb1a6c09c18376d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_c937c82ba84a7102200a3fa5d18569ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3aea1f8497aa240cd4ff57c38231be9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_af9c8e16a81560aef229d4ebe7865969.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_586a31a357de96d9fef2fe0d90817c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0ec278a4492d691e8143d3886ffaca9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_3b641955202b1816fa517a66ff058ddf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_ea1409762517a976311e78a50da1114b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_7c7de13f24c20d32d53ac7fe0e9405c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170a62df-b85a-51cd-95b0-555fed14e4af/170a62df-b85a-51cd-95b0-555fed14e4af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30c8b36886be7325903040aecd9978/pa/GE60554_0310cf2c01c5816998fc7e9060c68f16.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE60554%27 HTTP/1.1" 200 None
2026-03-30 12:28:23 [auto1.fr] INFO: Saving data for GE60554: {'created_time': 1774873703.184484, 'last_price_update_time': 1774873703.184495, 'auction_closing_time': 1774970861.0}
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE60554') HTTP/1.1" 204 0
2026-03-30 12:28:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV74591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV74591> (referer: https://www.auto1.com/v1/car-details-view/JV74591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13 with identifier: JV74591
2026-03-30 12:28:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13 with scrape type 1
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_5cbbcc62fdee37dd98e6f099c0fa8749.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_5cbbcc62fdee37dd98e6f099c0fa8749.jpg already downloaded
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_889dfa86f11f1c6885ce707ccf473ef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_889dfa86f11f1c6885ce707ccf473ef7.jpg already downloaded
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_aa78c27eb8d9ec3e96f6ea900fdd0091.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_aa78c27eb8d9ec3e96f6ea900fdd0091.jpg already downloaded
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_b44b785546f59ae45722db913e35207b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_b44b785546f59ae45722db913e35207b.jpg already downloaded
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_31a8766e4f6dde5162c6444967b34ffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_31a8766e4f6dde5162c6444967b34ffc.jpg already downloaded
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fed%252Fabed882d6171934939d72ad3cbcbfaf4%252Fpa%252FJV74591_2297b71541af2fc4b0e4721d096baa0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_2297b71541af2fc4b0e4721d096baa0d.jpg already downloaded
2026-03-30 12:28:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13, identifier: JV74591
2026-03-30 12:28:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13 with identifier: JV74591
2026-03-30 12:28:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13 with identifier: JV74591
2026-03-30 12:28:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13 with identifier: JV74591 to the API
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV74591>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:50:00Z',
'fuel_type': 'diesel',
'id': '2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV74591',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Audi',
'model': 'A4',
'odometer': 274017,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_5cbbcc62fdee37dd98e6f099c0fa8749.jpg',
'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_889dfa86f11f1c6885ce707ccf473ef7.jpg',
'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_aa78c27eb8d9ec3e96f6ea900fdd0091.jpg',
'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_b44b785546f59ae45722db913e35207b.jpg',
'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_31a8766e4f6dde5162c6444967b34ffc.jpg',
'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_2297b71541af2fc4b0e4721d096baa0d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_5cbbcc62fdee37dd98e6f099c0fa8749.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_889dfa86f11f1c6885ce707ccf473ef7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_aa78c27eb8d9ec3e96f6ea900fdd0091.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_b44b785546f59ae45722db913e35207b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_31a8766e4f6dde5162c6444967b34ffc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13/2abffd5c-5bbc-5471-8edf-8d9e4c9e5b13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/ed/abed882d6171934939d72ad3cbcbfaf4/pa/JV74591_2297b71541af2fc4b0e4721d096baa0d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV74591%27 HTTP/1.1" 200 None
2026-03-30 12:28:26 [auto1.fr] INFO: Saving data for JV74591: {'created_time': 1774873706.364906, 'last_price_update_time': 1774873706.364917, 'auction_closing_time': 1774972200.0}
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV74591') HTTP/1.1" 204 0
2026-03-30 12:28:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:27 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 5763 | hits on page: 40
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: EC34278
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: WF80383
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF80383%27 HTTP/1.1" 200 None
2026-03-30 12:28:27 [auto1.fr] INFO: Scrape type for WF80383: 0
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: SB53559
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: GG43203
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: NN21881
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN21881%27 HTTP/1.1" 200 None
2026-03-30 12:28:27 [auto1.fr] INFO: Scrape type for NN21881: 1
2026-03-30 12:28:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: ET30983
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: JS22176
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: VS20220
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: TK02399
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: PH49145
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: ZE29063
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: ZV46129
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: PM66643
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: XD68229
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: LS37547
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: YH14839
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: RK82051
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: YL06097
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: SK43844
2026-03-30 12:28:27 [auto1.fr] INFO: Found listing with ID: FX27811
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX27811%27 HTTP/1.1" 200 None
2026-03-30 12:28:27 [auto1.fr] INFO: Scrape type for FX27811: 2
2026-03-30 12:28:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with identifier: FX27811
2026-03-30 12:28:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with scrape type 2
2026-03-30 12:28:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with scrape type 2
2026-03-30 12:28:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d8a6dae-d3f9-5f93-8328-2e26186b7742, identifier: FX27811
2026-03-30 12:28:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with identifier: FX27811
2026-03-30 12:28:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with identifier: FX27811
2026-03-30 12:28:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d8a6dae-d3f9-5f93-8328-2e26186b7742 with identifier: FX27811 to the API
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:40:33Z',
'fuel_type': 'petrol',
'id': '1d8a6dae-d3f9-5f93-8328-2e26186b7742',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX27811',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 154415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-04',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2010}
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX27811%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Saving data for FX27811: {'auction_closing_time': 1774971633.0, 'created_time': 1773254814.722057, 'last_price_update_time': 1774873708.307379}
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX27811') HTTP/1.1" 204 0
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: CT78208
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: VT90507
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT90507%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for VT90507: 1
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: KH76929
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: AN07347
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN07347%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for AN07347: 1
2026-03-30 12:28:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA43033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: HB98578
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB98578%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for HB98578: 1
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: RH39246
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: PY51333
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: UA06834
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: JV30331
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: LM24341
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: VB98867
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB98867%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for VB98867: 1
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: YC82706
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC82706%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for YC82706: 1
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: EP61316
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: JY39287
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: LJ73279
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: PU36088
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU36088%27 HTTP/1.1" 200 None
2026-03-30 12:28:28 [auto1.fr] INFO: Scrape type for PU36088: 1
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: TE38674
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: WV33218
2026-03-30 12:28:28 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 12:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:29 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 5764 | hits on page: 40
2026-03-30 12:28:29 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 12:28:29 [auto1.fr] INFO: Found listing with ID: JC65585
2026-03-30 12:28:29 [auto1.fr] INFO: Found listing with ID: UZ77285
2026-03-30 12:28:29 [auto1.fr] INFO: Found listing with ID: CK52934
2026-03-30 12:28:29 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL15775%27 HTTP/1.1" 200 None
2026-03-30 12:28:29 [auto1.fr] INFO: Scrape type for ZL15775: 2
2026-03-30 12:28:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-03-30 12:28:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581af0e1-825b-531b-9738-b6aeefc7513a with scrape type 2
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581af0e1-825b-531b-9738-b6aeefc7513a with scrape type 2
2026-03-30 12:28:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 581af0e1-825b-531b-9738-b6aeefc7513a, identifier: ZL15775
2026-03-30 12:28:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-03-30 12:28:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-03-30 12:28:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775 to the API
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:09:32Z',
'fuel_type': 'diesel',
'id': '581af0e1-825b-531b-9738-b6aeefc7513a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15775',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 311593,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-23',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL15775%27 HTTP/1.1" 200 None
2026-03-30 12:28:30 [auto1.fr] INFO: Saving data for ZL15775: {'auction_closing_time': 1774969772.0, 'created_time': 1773676643.241839, 'last_price_update_time': 1774873710.46416}
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL15775') HTTP/1.1" 204 0
2026-03-30 12:28:30 [auto1.fr] INFO: Found listing with ID: RN04117
2026-03-30 12:28:30 [auto1.fr] INFO: Found listing with ID: KK86719
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK86719%27 HTTP/1.1" 200 None
2026-03-30 12:28:30 [auto1.fr] INFO: Scrape type for KK86719: 2
2026-03-30 12:28:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3229c916-3553-5d57-b38a-50b5bc607f27 with identifier: KK86719
2026-03-30 12:28:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3229c916-3553-5d57-b38a-50b5bc607f27 with scrape type 2
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3229c916-3553-5d57-b38a-50b5bc607f27 with scrape type 2
2026-03-30 12:28:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3229c916-3553-5d57-b38a-50b5bc607f27, identifier: KK86719
2026-03-30 12:28:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3229c916-3553-5d57-b38a-50b5bc607f27 with identifier: KK86719
2026-03-30 12:28:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3229c916-3553-5d57-b38a-50b5bc607f27 with identifier: KK86719
2026-03-30 12:28:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3229c916-3553-5d57-b38a-50b5bc607f27 with identifier: KK86719 to the API
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:46:46Z',
'fuel_type': 'diesel',
'id': '3229c916-3553-5d57-b38a-50b5bc607f27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK86719',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 178698,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Business Momentum',
'transmission': 'automatic',
'trim': 'Business Momentum',
'year': 2017}
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK86719%27 HTTP/1.1" 200 None
2026-03-30 12:28:30 [auto1.fr] INFO: Saving data for KK86719: {'auction_closing_time': 1774972006.0, 'created_time': 1774279295.337259, 'last_price_update_time': 1774873710.993689}
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KK86719') HTTP/1.1" 204 0
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: XE90293
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: XK60858
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: YU78646
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU78646%27 HTTP/1.1" 200 None
2026-03-30 12:28:31 [auto1.fr] INFO: Scrape type for YU78646: 2
2026-03-30 12:28:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc341ba-36ea-576d-ac5f-36693318fc17 with identifier: YU78646
2026-03-30 12:28:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc341ba-36ea-576d-ac5f-36693318fc17 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc341ba-36ea-576d-ac5f-36693318fc17 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bc341ba-36ea-576d-ac5f-36693318fc17, identifier: YU78646
2026-03-30 12:28:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bc341ba-36ea-576d-ac5f-36693318fc17 with identifier: YU78646
2026-03-30 12:28:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bc341ba-36ea-576d-ac5f-36693318fc17 with identifier: YU78646
2026-03-30 12:28:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bc341ba-36ea-576d-ac5f-36693318fc17 with identifier: YU78646 to the API
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:43Z',
'fuel_type': 'petrol',
'id': '5bc341ba-36ea-576d-ac5f-36693318fc17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU78646',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 40505,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2024}
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU78646%27 HTTP/1.1" 200 None
2026-03-30 12:28:31 [auto1.fr] INFO: Saving data for YU78646: {'auction_closing_time': 1774970563.0, 'created_time': 1772816993.767249, 'last_price_update_time': 1774873711.817566}
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU78646') HTTP/1.1" 204 0
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: UT37188
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: AS29663
2026-03-30 12:28:31 [auto1.fr] INFO: Found listing with ID: GR61820
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR61820%27 HTTP/1.1" 200 None
2026-03-30 12:28:31 [auto1.fr] INFO: Scrape type for GR61820: 2
2026-03-30 12:28:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3a00016-738e-5ecf-b517-7284a47c7133 with identifier: GR61820
2026-03-30 12:28:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a00016-738e-5ecf-b517-7284a47c7133 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3a00016-738e-5ecf-b517-7284a47c7133 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3a00016-738e-5ecf-b517-7284a47c7133, identifier: GR61820
2026-03-30 12:28:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3a00016-738e-5ecf-b517-7284a47c7133 with identifier: GR61820
2026-03-30 12:28:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3a00016-738e-5ecf-b517-7284a47c7133 with identifier: GR61820
2026-03-30 12:28:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3a00016-738e-5ecf-b517-7284a47c7133 with identifier: GR61820 to the API
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:03:33Z',
'fuel_type': 'petrol',
'id': 'b3a00016-738e-5ecf-b517-7284a47c7133',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR61820',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 155917,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-27',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2009}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR61820%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.fr] INFO: Saving data for GR61820: {'auction_closing_time': 1774969413.0, 'created_time': 1773760872.47224, 'last_price_update_time': 1774873712.252444}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GR61820') HTTP/1.1" 204 0
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: RL98096
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: LN69242
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: PE74944
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE74944%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.fr] INFO: Scrape type for PE74944: 1
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: AF39730
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: GV72759
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: NC92603
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: HM15892
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: VG13093
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: DS08548
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: ZL76511
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: AY12209
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: HS41994
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: JK78743
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: AB32696
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: NU28621
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: XB55824
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: UL28191
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: VN55404
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: WS14634
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: NA77187
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA77187%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.fr] INFO: Scrape type for NA77187: 0
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: JH89520
2026-03-30 12:28:32 [auto1.fr] INFO: Found listing with ID: YS10684
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS10684%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.fr] INFO: Scrape type for YS10684: 0
2026-03-30 12:28:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT90507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN21881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE74944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU36088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN07347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN21881> (referer: https://www.auto1.com/v1/car-details-view/NN21881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with identifier: NN21881
2026-03-30 12:28:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with scrape type 1
2026-03-30 12:28:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_0e4ed1e376899092cb5396e5411cddf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0e4ed1e376899092cb5396e5411cddf4.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_6cbd722019b7d59a509bb813accbc455.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6cbd722019b7d59a509bb813accbc455.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_c491ae59b98efefa86bd18a740b9e728.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_c491ae59b98efefa86bd18a740b9e728.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_8314a3caca40d51a7889415bf9ec084a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_8314a3caca40d51a7889415bf9ec084a.jpg not downloaded yet
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_6b0e7cd50b82127307a2bf6939249332.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6b0e7cd50b82127307a2bf6939249332.jpg not downloaded yet
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0e4ed1e376899092cb5396e5411cddf4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg not downloaded yet
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_0369b83f91cce80185667099521bcf7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0369b83f91cce80185667099521bcf7e.jpg not downloaded yet
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6cbd722019b7d59a509bb813accbc455.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_f8d69503faa8817b06b7fd4d940efd13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_f8d69503faa8817b06b7fd4d940efd13.jpg not downloaded yet
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_c491ae59b98efefa86bd18a740b9e728.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2ee810>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_f8d69503faa8817b06b7fd4d940efd13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6b0e7cd50b82127307a2bf6939249332.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0369b83f91cce80185667099521bcf7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca245a10>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_0e4ed1e376899092cb5396e5411cddf4.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0e4ed1e376899092cb5396e5411cddf4.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_8314a3caca40d51a7889415bf9ec084a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2aaed0>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_6cbd722019b7d59a509bb813accbc455.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6cbd722019b7d59a509bb813accbc455.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca15cdd0>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_c491ae59b98efefa86bd18a740b9e728.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_c491ae59b98efefa86bd18a740b9e728.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac60b10>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_f8d69503faa8817b06b7fd4d940efd13.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_f8d69503faa8817b06b7fd4d940efd13.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca262590>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab59410>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_6b0e7cd50b82127307a2bf6939249332.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6b0e7cd50b82127307a2bf6939249332.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2e7b90>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_0369b83f91cce80185667099521bcf7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0369b83f91cce80185667099521bcf7e.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac63710>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922eb90>
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Faa%252F38aa905b790eee9c76def7891b20c5de%252Fpa%252FNN21881_8314a3caca40d51a7889415bf9ec084a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_8314a3caca40d51a7889415bf9ec084a.jpg saved to cache
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0
2026-03-30 12:28:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79b24113-d70a-5797-b425-6f4dd5b7e2f0, skipping ID generation
2026-03-30 12:28:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with scrape type 1
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79b24113-d70a-5797-b425-6f4dd5b7e2f0 sending to next pipeline
2026-03-30 12:28:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79b24113-d70a-5797-b425-6f4dd5b7e2f0, identifier: NN21881
2026-03-30 12:28:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with identifier: NN21881
2026-03-30 12:28:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with identifier: NN21881
2026-03-30 12:28:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79b24113-d70a-5797-b425-6f4dd5b7e2f0 with identifier: NN21881 to the API
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_8314a3caca40d51a7889415bf9ec084a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:50:14Z',
'fuel_type': 'petrol',
'id': '79b24113-d70a-5797-b425-6f4dd5b7e2f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN21881',
'listing': 'auction',
'location': 'FR, Aix-en-Provence',
'make': 'Peugeot',
'model': '3008',
'odometer': 79972,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_7a015785ac6aaa8c3e89e0482f7f25c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0e4ed1e376899092cb5396e5411cddf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6cbd722019b7d59a509bb813accbc455.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_cb0bbd3bd904b63df83fbba8a6e6b276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_c491ae59b98efefa86bd18a740b9e728.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_8314a3caca40d51a7889415bf9ec084a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_6b0e7cd50b82127307a2bf6939249332.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_bbda40ed913c5bc6fec1ff53a581fdf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_0369b83f91cce80185667099521bcf7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b24113-d70a-5797-b425-6f4dd5b7e2f0/79b24113-d70a-5797-b425-6f4dd5b7e2f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/aa/38aa905b790eee9c76def7891b20c5de/pa/NN21881_f8d69503faa8817b06b7fd4d940efd13.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN21881%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.fr] INFO: Saving data for NN21881: {'created_time': 1774873719.343108, 'last_price_update_time': 1774873719.343119, 'auction_closing_time': 1774972214.0}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN21881') HTTP/1.1" 204 0
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA43033> (referer: https://www.auto1.com/v1/car-details-view/RA43033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with identifier: RA43033
2026-03-30 12:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with scrape type 1
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_919ece8bf7c78486bf59c61287ca8752.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_919ece8bf7c78486bf59c61287ca8752.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_7cc0f5a9c0ec359a188c75711e474318.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_7cc0f5a9c0ec359a188c75711e474318.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_be95b8d25854425f12f213a15043311c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_be95b8d25854425f12f213a15043311c.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_455c4cc43a7a570c0309dd3fee966495.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_455c4cc43a7a570c0309dd3fee966495.jpg not downloaded yet
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg not downloaded yet
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_919ece8bf7c78486bf59c61287ca8752.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_7cc0f5a9c0ec359a188c75711e474318.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_f565868fe4177c2ee932da8df2122886.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_f565868fe4177c2ee932da8df2122886.jpg not downloaded yet
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg not downloaded yet
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_455c4cc43a7a570c0309dd3fee966495.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_be95b8d25854425f12f213a15043311c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_95d263892adad9aa9c6993e515632e16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_95d263892adad9aa9c6993e515632e16.jpg not downloaded yet
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b8050>
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_919ece8bf7c78486bf59c61287ca8752.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_919ece8bf7c78486bf59c61287ca8752.jpg saved to cache
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b41210>
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_7cc0f5a9c0ec359a188c75711e474318.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_7cc0f5a9c0ec359a188c75711e474318.jpg saved to cache
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_95d263892adad9aa9c6993e515632e16.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_f565868fe4177c2ee932da8df2122886.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1aeed0>
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b2790>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_455c4cc43a7a570c0309dd3fee966495.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_455c4cc43a7a570c0309dd3fee966495.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca264050>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_be95b8d25854425f12f213a15043311c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_be95b8d25854425f12f213a15043311c.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca266e50>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2a9c10>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_95d263892adad9aa9c6993e515632e16.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_95d263892adad9aa9c6993e515632e16.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2cf4d0>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_f565868fe4177c2ee932da8df2122886.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_f565868fe4177c2ee932da8df2122886.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac73cd0>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac61410>
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe4%252F82e4029bb3543e1dbdd3e6b5fe4edf55%252Fpa%252FRA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg saved to cache
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4
2026-03-30 12:28:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4, skipping ID generation
2026-03-30 12:28:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with scrape type 1
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 sending to next pipeline
2026-03-30 12:28:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4, identifier: RA43033
2026-03-30 12:28:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with identifier: RA43033
2026-03-30 12:28:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with identifier: RA43033
2026-03-30 12:28:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4 with identifier: RA43033 to the API
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:52:40Z',
'fuel_type': 'diesel',
'id': 'e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA43033',
'listing': 'auction',
'location': 'FR, Saint-Maur-des-Fossés',
'make': 'Peugeot',
'model': '3008',
'odometer': 140644,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_919ece8bf7c78486bf59c61287ca8752.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_7cc0f5a9c0ec359a188c75711e474318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_be95b8d25854425f12f213a15043311c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_c586aa5dc218dcc17d0f943c94f51f21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_d19f7b10d3315c2def185fca12c4f9c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_455c4cc43a7a570c0309dd3fee966495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_5e9f76d9049d465f3ba29bc61344c13a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_f565868fe4177c2ee932da8df2122886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_fd6b7e2d0190a7c034f343be70e6dbd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4/e37d4c4f-9508-5e0a-bf87-d7a19f6b4fc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e4/82e4029bb3543e1dbdd3e6b5fe4edf55/pa/RA43033_95d263892adad9aa9c6993e515632e16.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA43033%27 HTTP/1.1" 200 None
2026-03-30 12:28:40 [auto1.fr] INFO: Saving data for RA43033: {'created_time': 1774873720.853625, 'last_price_update_time': 1774873720.853639, 'auction_closing_time': 1774972360.0}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA43033') HTTP/1.1" 204 0
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB98578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT90507> (referer: https://www.auto1.com/v1/car-details-view/VT90507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5334578e-d48a-5411-9c82-7942c214af17 with identifier: VT90507
2026-03-30 12:28:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5334578e-d48a-5411-9c82-7942c214af17 with scrape type 1
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_0473ed967b303a7ce47c55f2214aca48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_0473ed967b303a7ce47c55f2214aca48.jpg not downloaded yet
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_1cc6098f621c4c357d1149968e075ad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_1cc6098f621c4c357d1149968e075ad2.jpg not downloaded yet
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_7866a533a12d735f72582686861008e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7866a533a12d735f72582686861008e3.jpg not downloaded yet
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_f339a8339663f8a4878ab18c32fee5c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f339a8339663f8a4878ab18c32fee5c8.jpg not downloaded yet
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_f9818df65db3af6584e06f89ebb54bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f9818df65db3af6584e06f89ebb54bf2.jpg not downloaded yet
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg not downloaded yet
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_1cc6098f621c4c357d1149968e075ad2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_0473ed967b303a7ce47c55f2214aca48.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7866a533a12d735f72582686861008e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f339a8339663f8a4878ab18c32fee5c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f9818df65db3af6584e06f89ebb54bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcab439d0>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_1cc6098f621c4c357d1149968e075ad2.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_1cc6098f621c4c357d1149968e075ad2.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc92276d0>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_0473ed967b303a7ce47c55f2214aca48.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_0473ed967b303a7ce47c55f2214aca48.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12f850>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_7866a533a12d735f72582686861008e3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7866a533a12d735f72582686861008e3.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0dc2610>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_f339a8339663f8a4878ab18c32fee5c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f339a8339663f8a4878ab18c32fee5c8.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b7650>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_f9818df65db3af6584e06f89ebb54bf2.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f9818df65db3af6584e06f89ebb54bf2.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca264d90>
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fce%252F7fceb97b92650f2b07b713bbf79f3bb5%252Fpa%252FVT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg saved to cache
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5334578e-d48a-5411-9c82-7942c214af17
2026-03-30 12:28:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5334578e-d48a-5411-9c82-7942c214af17, skipping ID generation
2026-03-30 12:28:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5334578e-d48a-5411-9c82-7942c214af17 with scrape type 1
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5334578e-d48a-5411-9c82-7942c214af17 sending to next pipeline
2026-03-30 12:28:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5334578e-d48a-5411-9c82-7942c214af17, identifier: VT90507
2026-03-30 12:28:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5334578e-d48a-5411-9c82-7942c214af17 with identifier: VT90507
2026-03-30 12:28:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5334578e-d48a-5411-9c82-7942c214af17 with identifier: VT90507
2026-03-30 12:28:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5334578e-d48a-5411-9c82-7942c214af17 with identifier: VT90507 to the API
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:35Z',
'fuel_type': 'diesel',
'id': '5334578e-d48a-5411-9c82-7942c214af17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT90507',
'listing': 'auction',
'location': 'FR, Artigues-près-Bordeaux',
'make': 'Renault',
'model': 'Trafic',
'odometer': 320501,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_0473ed967b303a7ce47c55f2214aca48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_1cc6098f621c4c357d1149968e075ad2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7866a533a12d735f72582686861008e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f339a8339663f8a4878ab18c32fee5c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_f9818df65db3af6584e06f89ebb54bf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334578e-d48a-5411-9c82-7942c214af17/5334578e-d48a-5411-9c82-7942c214af17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/ce/7fceb97b92650f2b07b713bbf79f3bb5/pa/VT90507_7c161f24866f3f27c0d860e5ba2377c8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-09-25',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L1H1 2,7t',
'transmission': 'manual',
'trim': 'L1H1 2,7t',
'year': 2008}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT90507%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.fr] INFO: Saving data for VT90507: {'created_time': 1774873728.063735, 'last_price_update_time': 1774873728.063748, 'auction_closing_time': 1774969295.0}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VT90507') HTTP/1.1" 204 0
2026-03-30 12:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB98867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC82706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:48 [scrapy.extensions.logstats] INFO: Crawled 271 pages (at 25 pages/min), scraped 208 items (at 17 items/min)
2026-03-30 12:28:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:28:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC82706> (referer: https://www.auto1.com/v1/car-details-view/YC82706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c721b0bb-b47b-58da-ae54-d4d16deec20b with identifier: YC82706
2026-03-30 12:28:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c721b0bb-b47b-58da-ae54-d4d16deec20b with scrape type 1
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c721b0bb-b47b-58da-ae54-d4d16deec20b
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_7d1f31303c5dba2b3aa8ad4963c1bf63.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_7d1f31303c5dba2b3aa8ad4963c1bf63.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_e58ca83c4e3f6ccaf2abeaa05f3113f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e58ca83c4e3f6ccaf2abeaa05f3113f3.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_aad76c1e279089d71a5e135928aad2a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_aad76c1e279089d71a5e135928aad2a9.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_5d53b75dd87a569e6659544603229628.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_5d53b75dd87a569e6659544603229628.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_c0823144885a920e3e0fe29735975039.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_c0823144885a920e3e0fe29735975039.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_e3c76a54e250e56e73f50b29c5e3b6f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e3c76a54e250e56e73f50b29c5e3b6f8.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_49b2238b6753edb9c095c510b56ec097.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_49b2238b6753edb9c095c510b56ec097.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_6e1addcc5f085ae287029653c6b1bd42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_6e1addcc5f085ae287029653c6b1bd42.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_ee2dc9ceccf386694bd355d08b8f9f49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_ee2dc9ceccf386694bd355d08b8f9f49.jpg already downloaded
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fec%252F5decf4bb4caa4c83b894d6d93292dbbd%252Fpa%252FYC82706_cb98fa8b7883bcf6c49d4d06ac34ef70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_cb98fa8b7883bcf6c49d4d06ac34ef70.jpg already downloaded
2026-03-30 12:28:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c721b0bb-b47b-58da-ae54-d4d16deec20b, identifier: YC82706
2026-03-30 12:28:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c721b0bb-b47b-58da-ae54-d4d16deec20b with identifier: YC82706
2026-03-30 12:28:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c721b0bb-b47b-58da-ae54-d4d16deec20b with identifier: YC82706
2026-03-30 12:28:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c721b0bb-b47b-58da-ae54-d4d16deec20b with identifier: YC82706 to the API
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC82706>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:19:11Z',
'fuel_type': 'petrol',
'id': 'c721b0bb-b47b-58da-ae54-d4d16deec20b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC82706',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C4',
'odometer': 36117,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_7d1f31303c5dba2b3aa8ad4963c1bf63.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e58ca83c4e3f6ccaf2abeaa05f3113f3.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_aad76c1e279089d71a5e135928aad2a9.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_5d53b75dd87a569e6659544603229628.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_c0823144885a920e3e0fe29735975039.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e3c76a54e250e56e73f50b29c5e3b6f8.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_49b2238b6753edb9c095c510b56ec097.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_6e1addcc5f085ae287029653c6b1bd42.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_ee2dc9ceccf386694bd355d08b8f9f49.jpg',
'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_cb98fa8b7883bcf6c49d4d06ac34ef70.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_7d1f31303c5dba2b3aa8ad4963c1bf63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e58ca83c4e3f6ccaf2abeaa05f3113f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_aad76c1e279089d71a5e135928aad2a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_5d53b75dd87a569e6659544603229628.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_c0823144885a920e3e0fe29735975039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_e3c76a54e250e56e73f50b29c5e3b6f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2539228,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_49b2238b6753edb9c095c510b56ec097.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_6e1addcc5f085ae287029653c6b1bd42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_ee2dc9ceccf386694bd355d08b8f9f49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c721b0bb-b47b-58da-ae54-d4d16deec20b/c721b0bb-b47b-58da-ae54-d4d16deec20b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decf4bb4caa4c83b894d6d93292dbbd/pa/YC82706_cb98fa8b7883bcf6c49d4d06ac34ef70.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-08',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.2 e-THP Millenium',
'transmission': 'manual',
'trim': 'Millenium',
'year': 2017}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC82706%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [auto1.fr] INFO: Saving data for YC82706: {'created_time': 1774873730.271155, 'last_price_update_time': 1774873730.271165, 'auction_closing_time': 1774970351.0}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC82706') HTTP/1.1" 204 0
2026-03-30 12:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB98867> (referer: https://www.auto1.com/v1/car-details-view/VB98867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec771fae-3402-5f0b-afbb-423b500e4de1 with identifier: VB98867
2026-03-30 12:28:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec771fae-3402-5f0b-afbb-423b500e4de1 with scrape type 1
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec771fae-3402-5f0b-afbb-423b500e4de1
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_ce538e34a52e5075db1db45550748a3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_ce538e34a52e5075db1db45550748a3a.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_14d80a4fa1b3450c7bc1f9a164677c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_14d80a4fa1b3450c7bc1f9a164677c0d.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_165965e9c05c6d7e9590850f0c82bba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_165965e9c05c6d7e9590850f0c82bba6.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_a099bcea00864aef1a288e9c815a3674.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_a099bcea00864aef1a288e9c815a3674.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_78e44c0c1d860d7788cc01d93e79fa06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_78e44c0c1d860d7788cc01d93e79fa06.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_838499657c55a9b892e060f3eafbf6c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_838499657c55a9b892e060f3eafbf6c3.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_036fc82b649876c7f32b8f22b242cef9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_036fc82b649876c7f32b8f22b242cef9.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_eef18602f0b4476aae2a8ebeeb8b332d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_eef18602f0b4476aae2a8ebeeb8b332d.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_f81049dee1f800af6d563278fffc1253.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_f81049dee1f800af6d563278fffc1253.jpg already downloaded
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fe3%252F05e3fd17dcb574bf4dc9071d34385472%252Fpa%252FVB98867_c38e6fc3d3b9cd8766b87a9c35e74522.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_c38e6fc3d3b9cd8766b87a9c35e74522.jpg already downloaded
2026-03-30 12:28:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec771fae-3402-5f0b-afbb-423b500e4de1, identifier: VB98867
2026-03-30 12:28:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec771fae-3402-5f0b-afbb-423b500e4de1 with identifier: VB98867
2026-03-30 12:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec771fae-3402-5f0b-afbb-423b500e4de1 with identifier: VB98867
2026-03-30 12:28:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec771fae-3402-5f0b-afbb-423b500e4de1 with identifier: VB98867 to the API
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VB98867>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:26:00Z',
'fuel_type': 'petrol',
'id': 'ec771fae-3402-5f0b-afbb-423b500e4de1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB98867',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '207',
'odometer': 83927,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_ce538e34a52e5075db1db45550748a3a.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_14d80a4fa1b3450c7bc1f9a164677c0d.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_165965e9c05c6d7e9590850f0c82bba6.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_a099bcea00864aef1a288e9c815a3674.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_78e44c0c1d860d7788cc01d93e79fa06.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_838499657c55a9b892e060f3eafbf6c3.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_036fc82b649876c7f32b8f22b242cef9.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_eef18602f0b4476aae2a8ebeeb8b332d.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_f81049dee1f800af6d563278fffc1253.jpg',
'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_c38e6fc3d3b9cd8766b87a9c35e74522.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_ce538e34a52e5075db1db45550748a3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_14d80a4fa1b3450c7bc1f9a164677c0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_165965e9c05c6d7e9590850f0c82bba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2511977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_a099bcea00864aef1a288e9c815a3674.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546884,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_78e44c0c1d860d7788cc01d93e79fa06.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2558962,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_838499657c55a9b892e060f3eafbf6c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_036fc82b649876c7f32b8f22b242cef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_eef18602f0b4476aae2a8ebeeb8b332d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_f81049dee1f800af6d563278fffc1253.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec771fae-3402-5f0b-afbb-423b500e4de1/ec771fae-3402-5f0b-afbb-423b500e4de1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/e3/05e3fd17dcb574bf4dc9071d34385472/pa/VB98867_c38e6fc3d3b9cd8766b87a9c35e74522.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 Feline',
'transmission': 'automatic',
'trim': 'Feline',
'year': 2007}
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB98867%27 HTTP/1.1" 200 None
2026-03-30 12:28:54 [auto1.fr] INFO: Saving data for VB98867: {'created_time': 1774873734.132378, 'last_price_update_time': 1774873734.132388, 'auction_closing_time': 1774970760.0}
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VB98867') HTTP/1.1" 204 0
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU36088> (referer: https://www.auto1.com/v1/car-details-view/PU36088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE74944> (referer: https://www.auto1.com/v1/car-details-view/PE74944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c982cd8-656f-583f-a412-6eea0a1e84a8 with identifier: PU36088
2026-03-30 12:28:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c982cd8-656f-583f-a412-6eea0a1e84a8 with scrape type 1
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_dde1be9a258034890eb15a24c39e5901.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_dde1be9a258034890eb15a24c39e5901.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_d2612b87456df34f1153e6abb50761c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2612b87456df34f1153e6abb50761c0.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_7d8ab14b2c76483125e232396323e8b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_7d8ab14b2c76483125e232396323e8b0.jpg not downloaded yet
2026-03-30 12:28:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3610ff6f-5fd6-50b6-ab9e-820e831c9780 with identifier: PE74944
2026-03-30 12:28:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3610ff6f-5fd6-50b6-ab9e-820e831c9780 with scrape type 1
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3610ff6f-5fd6-50b6-ab9e-820e831c9780
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_a13ca86316379e6ec18eccb83190a955.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_a13ca86316379e6ec18eccb83190a955.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_1de13b11757818183b97afa5337f4e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1de13b11757818183b97afa5337f4e29.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_0081fb3e27ad66812b9d4bd7f8f9011d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0081fb3e27ad66812b9d4bd7f8f9011d.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_1f585a545d58a63995af5e90b4519e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1f585a545d58a63995af5e90b4519e56.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_f812913b06d66ff995aa9c786cefd5ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_f812913b06d66ff995aa9c786cefd5ac.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_3442cd25a53a4185aed59c07c39d6c1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_3442cd25a53a4185aed59c07c39d6c1f.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_0bb609f90a478e4c75a5622e320c37c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0bb609f90a478e4c75a5622e320c37c5.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_c252fe9b201b09ed92ca6ac6ca55c044.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_c252fe9b201b09ed92ca6ac6ca55c044.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_15cc2be4587fb8cb9d8469dacf29e097.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_15cc2be4587fb8cb9d8469dacf29e097.jpg already downloaded
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0f%252F940ff4fc4fdd2aaaa030c6197d329654%252Fpa%252FPE74944_d7c4416e9bda6e22c6b076901a015500.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_d7c4416e9bda6e22c6b076901a015500.jpg already downloaded
2026-03-30 12:28:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3610ff6f-5fd6-50b6-ab9e-820e831c9780, identifier: PE74944
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg not downloaded yet
2026-03-30 12:28:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3610ff6f-5fd6-50b6-ab9e-820e831c9780 with identifier: PE74944
2026-03-30 12:28:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3610ff6f-5fd6-50b6-ab9e-820e831c9780 with identifier: PE74944
2026-03-30 12:28:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3610ff6f-5fd6-50b6-ab9e-820e831c9780 with identifier: PE74944 to the API
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE74944>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:53:34Z',
'fuel_type': 'diesel',
'id': '3610ff6f-5fd6-50b6-ab9e-820e831c9780',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE74944',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Peugeot',
'model': '3008',
'odometer': 197896,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_a13ca86316379e6ec18eccb83190a955.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1de13b11757818183b97afa5337f4e29.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0081fb3e27ad66812b9d4bd7f8f9011d.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1f585a545d58a63995af5e90b4519e56.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_f812913b06d66ff995aa9c786cefd5ac.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_3442cd25a53a4185aed59c07c39d6c1f.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0bb609f90a478e4c75a5622e320c37c5.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_c252fe9b201b09ed92ca6ac6ca55c044.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_15cc2be4587fb8cb9d8469dacf29e097.jpg',
'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_d7c4416e9bda6e22c6b076901a015500.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_a13ca86316379e6ec18eccb83190a955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1de13b11757818183b97afa5337f4e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2728155,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0081fb3e27ad66812b9d4bd7f8f9011d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_1f585a545d58a63995af5e90b4519e56.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_f812913b06d66ff995aa9c786cefd5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_3442cd25a53a4185aed59c07c39d6c1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_0bb609f90a478e4c75a5622e320c37c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_c252fe9b201b09ed92ca6ac6ca55c044.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_15cc2be4587fb8cb9d8469dacf29e097.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3610ff6f-5fd6-50b6-ab9e-820e831c9780/3610ff6f-5fd6-50b6-ab9e-820e831c9780_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0f/940ff4fc4fdd2aaaa030c6197d329654/pa/PE74944_d7c4416e9bda6e22c6b076901a015500.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE74944%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.fr] INFO: Saving data for PE74944: {'created_time': 1774873737.583037, 'last_price_update_time': 1774873737.583047, 'auction_closing_time': 1774972414.0}
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE74944') HTTP/1.1" 204 0
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_dde1be9a258034890eb15a24c39e5901.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg not downloaded yet
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2612b87456df34f1153e6abb50761c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg not downloaded yet
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg not downloaded yet
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_d2e545037be376cd8c9f7bec69ececcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2e545037be376cd8c9f7bec69ececcb.jpg not downloaded yet
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_7d8ab14b2c76483125e232396323e8b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_3b3d1d8757403ede200672fce9d175a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3b3d1d8757403ede200672fce9d175a2.jpg not downloaded yet
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_797d3155c670affcd8a81d3fc0cca11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_797d3155c670affcd8a81d3fc0cca11d.jpg not downloaded yet
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca103790>
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_dde1be9a258034890eb15a24c39e5901.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_dde1be9a258034890eb15a24c39e5901.jpg saved to cache
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2e545037be376cd8c9f7bec69ececcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1192d0>
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_d2612b87456df34f1153e6abb50761c0.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2612b87456df34f1153e6abb50761c0.jpg saved to cache
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2b2550>
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_7d8ab14b2c76483125e232396323e8b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_7d8ab14b2c76483125e232396323e8b0.jpg saved to cache
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca100d50>
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg saved to cache
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3b3d1d8757403ede200672fce9d175a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_797d3155c670affcd8a81d3fc0cca11d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcac73e10>
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca125d50>
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca13d490>
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2bbcd0>
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_d2e545037be376cd8c9f7bec69ececcb.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2e545037be376cd8c9f7bec69ececcb.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca14bcd0>
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_3b3d1d8757403ede200672fce9d175a2.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3b3d1d8757403ede200672fce9d175a2.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca12ff50>
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F28%252Fee2862e2b51fc2793a62f02cde672ecb%252Fpa%252FPU36088_797d3155c670affcd8a81d3fc0cca11d.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_797d3155c670affcd8a81d3fc0cca11d.jpg saved to cache
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c982cd8-656f-583f-a412-6eea0a1e84a8
2026-03-30 12:28:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c982cd8-656f-583f-a412-6eea0a1e84a8, skipping ID generation
2026-03-30 12:28:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c982cd8-656f-583f-a412-6eea0a1e84a8 with scrape type 1
2026-03-30 12:28:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c982cd8-656f-583f-a412-6eea0a1e84a8 sending to next pipeline
2026-03-30 12:28:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c982cd8-656f-583f-a412-6eea0a1e84a8, identifier: PU36088
2026-03-30 12:28:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c982cd8-656f-583f-a412-6eea0a1e84a8 with identifier: PU36088
2026-03-30 12:28:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c982cd8-656f-583f-a412-6eea0a1e84a8 with identifier: PU36088
2026-03-30 12:28:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c982cd8-656f-583f-a412-6eea0a1e84a8 with identifier: PU36088 to the API
2026-03-30 12:28:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_797d3155c670affcd8a81d3fc0cca11d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:14:29Z',
'fuel_type': 'diesel',
'id': '0c982cd8-656f-583f-a412-6eea0a1e84a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU36088',
'listing': 'auction',
'location': 'FR, Chambray-Lès-Tours',
'make': 'Peugeot',
'model': '3008',
'odometer': 137718,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_dde1be9a258034890eb15a24c39e5901.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2612b87456df34f1153e6abb50761c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_7d8ab14b2c76483125e232396323e8b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3e94fb8ccc2ba2db4ec7ec74a81ffbfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_b59907fa46d6b8c51dfe3037e2cd0c0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_60b6c2b520dd92cd06fcd93f419941fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_c99bd481ad5bc4bc8ad26c9e2405d5fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_d2e545037be376cd8c9f7bec69ececcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_3b3d1d8757403ede200672fce9d175a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c982cd8-656f-583f-a412-6eea0a1e84a8/0c982cd8-656f-583f-a412-6eea0a1e84a8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/28/ee2862e2b51fc2793a62f02cde672ecb/pa/PU36088_797d3155c670affcd8a81d3fc0cca11d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Crossway',
'transmission': 'manual',
'trim': 'Crossway',
'year': 2015}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU36088%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.fr] INFO: Saving data for PU36088: {'created_time': 1774873739.47465, 'last_price_update_time': 1774873739.474662, 'auction_closing_time': 1774970069.0}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU36088') HTTP/1.1" 204 0
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB98578> (referer: https://www.auto1.com/v1/car-details-view/HB98578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786451ab-4684-5c8d-a717-9aa2cdd40760 with identifier: HB98578
2026-03-30 12:29:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786451ab-4684-5c8d-a717-9aa2cdd40760 with scrape type 1
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_057c01566b3427d83ba7b4b423c58ef0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_057c01566b3427d83ba7b4b423c58ef0.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_e9bb005155c568b2022db7ef46b70849.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_e9bb005155c568b2022db7ef46b70849.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_2befd9f9ae838b94d893587f14053be2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_2befd9f9ae838b94d893587f14053be2.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_6a943dc3b87e680301b9aec411e09c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_6a943dc3b87e680301b9aec411e09c96.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg not downloaded yet
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_057c01566b3427d83ba7b4b423c58ef0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_d35c1074f646a71c0fa163ae636feea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d35c1074f646a71c0fa163ae636feea3.jpg not downloaded yet
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_afe1d81ececfe0f49775991f80a162aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_afe1d81ececfe0f49775991f80a162aa.jpg not downloaded yet
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_e9bb005155c568b2022db7ef46b70849.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_2befd9f9ae838b94d893587f14053be2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg not downloaded yet
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_650d9b5b688158d06f77e1ebb44460f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_650d9b5b688158d06f77e1ebb44460f1.jpg not downloaded yet
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_6a943dc3b87e680301b9aec411e09c96.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca225190>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_057c01566b3427d83ba7b4b423c58ef0.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_057c01566b3427d83ba7b4b423c58ef0.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d35c1074f646a71c0fa163ae636feea3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_650d9b5b688158d06f77e1ebb44460f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca149f90>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ace90>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_e9bb005155c568b2022db7ef46b70849.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_e9bb005155c568b2022db7ef46b70849.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1064d0>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_2befd9f9ae838b94d893587f14053be2.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_2befd9f9ae838b94d893587f14053be2.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_afe1d81ececfe0f49775991f80a162aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcacd1690>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_6a943dc3b87e680301b9aec411e09c96.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_6a943dc3b87e680301b9aec411e09c96.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1ad350>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_d35c1074f646a71c0fa163ae636feea3.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d35c1074f646a71c0fa163ae636feea3.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca2f32d0>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_650d9b5b688158d06f77e1ebb44460f1.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_650d9b5b688158d06f77e1ebb44460f1.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd0b2d850>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefd13d3d50>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefde751750>
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F80%252Fc6804cb4359225ee0dd99269c32dd486%252Fpa%252FHB98578_afe1d81ececfe0f49775991f80a162aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_afe1d81ececfe0f49775991f80a162aa.jpg saved to cache
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 786451ab-4684-5c8d-a717-9aa2cdd40760
2026-03-30 12:29:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 786451ab-4684-5c8d-a717-9aa2cdd40760, skipping ID generation
2026-03-30 12:29:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786451ab-4684-5c8d-a717-9aa2cdd40760 with scrape type 1
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 786451ab-4684-5c8d-a717-9aa2cdd40760 sending to next pipeline
2026-03-30 12:29:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 786451ab-4684-5c8d-a717-9aa2cdd40760, identifier: HB98578
2026-03-30 12:29:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 786451ab-4684-5c8d-a717-9aa2cdd40760 with identifier: HB98578
2026-03-30 12:29:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 786451ab-4684-5c8d-a717-9aa2cdd40760 with identifier: HB98578
2026-03-30 12:29:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 786451ab-4684-5c8d-a717-9aa2cdd40760 with identifier: HB98578 to the API
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_afe1d81ececfe0f49775991f80a162aa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 83,
'expiration_date': '2026-03-31T15:52:44Z',
'fuel_type': 'petrol',
'id': '786451ab-4684-5c8d-a717-9aa2cdd40760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB98578',
'listing': 'auction',
'location': 'FR, Valence',
'make': 'Honda',
'model': 'Jazz',
'odometer': 79908,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_057c01566b3427d83ba7b4b423c58ef0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d49a5f8fddc50e47b3edd4ddc047e463.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_e9bb005155c568b2022db7ef46b70849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_2befd9f9ae838b94d893587f14053be2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_6a943dc3b87e680301b9aec411e09c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_0129e6b711c81039c0c12ba0ba1bd216.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_d35c1074f646a71c0fa163ae636feea3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_afe1d81ececfe0f49775991f80a162aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_15ba1c9566e52cf4d73e5fe0966d4c1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786451ab-4684-5c8d-a717-9aa2cdd40760/786451ab-4684-5c8d-a717-9aa2cdd40760_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/80/c6804cb4359225ee0dd99269c32dd486/pa/HB98578_650d9b5b688158d06f77e1ebb44460f1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.4 DSi ES',
'transmission': 'automatic',
'trim': 'ES',
'year': 2008}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB98578%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.fr] INFO: Saving data for HB98578: {'created_time': 1774873744.520903, 'last_price_update_time': 1774873744.520914, 'auction_closing_time': 1774972364.0}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HB98578') HTTP/1.1" 204 0
2026-03-30 12:29:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:09 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 5766 | hits on page: 40
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: JH89520
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: YS10684
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS10684%27 HTTP/1.1" 200 None
2026-03-30 12:29:09 [auto1.fr] INFO: Scrape type for YS10684: 0
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: TX45559
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: RP46008
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: RZ94972
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: DG00282
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG00282%27 HTTP/1.1" 200 None
2026-03-30 12:29:09 [auto1.fr] INFO: Scrape type for DG00282: 0
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: RG95907
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: FH61572
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH61572%27 HTTP/1.1" 200 None
2026-03-30 12:29:09 [auto1.fr] INFO: Scrape type for FH61572: 0
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: ZG40832
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: NL69056
2026-03-30 12:29:09 [auto1.fr] INFO: Found listing with ID: ET50464
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET50464%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for ET50464: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: FP01410
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: HC90791
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: TB91463
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB91463%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for TB91463: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: RX01850
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX01850%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for RX01850: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: PH66344
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH66344%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for PH66344: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: RL54968
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: TD64566
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD94763%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for FD94763: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX07863%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for JX07863: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH41219%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for RH41219: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ59660%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for JJ59660: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR63320%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for VR63320: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ10016%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.fr] INFO: Scrape type for AJ10016: 0
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 12:29:10 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 12:29:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN07347> (referer: https://www.auto1.com/v1/car-details-view/AN07347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 503bf05f-2059-53b1-a460-cdc89b2696f6 with identifier: AN07347
2026-03-30 12:29:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503bf05f-2059-53b1-a460-cdc89b2696f6 with scrape type 1
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7ab46515b522104a520ca165acfc5c6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7ab46515b522104a520ca165acfc5c6a.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7e064309280e44a6c2b4ce3599fa3124.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e064309280e44a6c2b4ce3599fa3124.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_852bb83e3da7f38f36bbe45784ae1294.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_852bb83e3da7f38f36bbe45784ae1294.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_edf32f88cc593645805ac78b8e5eff1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_edf32f88cc593645805ac78b8e5eff1a.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7e76574670e40889980a481278db4c17.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e76574670e40889980a481278db4c17.jpg not downloaded yet
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_2725e09d35b1d14aa372c2545f277ed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_2725e09d35b1d14aa372c2545f277ed6.jpg not downloaded yet
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7ab46515b522104a520ca165acfc5c6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg not downloaded yet
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg not downloaded yet
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e064309280e44a6c2b4ce3599fa3124.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg not downloaded yet
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca11b110>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_852bb83e3da7f38f36bbe45784ae1294.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca266a10>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7ab46515b522104a520ca165acfc5c6a.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7ab46515b522104a520ca165acfc5c6a.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922c150>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7e064309280e44a6c2b4ce3599fa3124.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e064309280e44a6c2b4ce3599fa3124.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e76574670e40889980a481278db4c17.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_2725e09d35b1d14aa372c2545f277ed6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_edf32f88cc593645805ac78b8e5eff1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefcacf4f10>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_852bb83e3da7f38f36bbe45784ae1294.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_852bb83e3da7f38f36bbe45784ae1294.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca126650>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc922ee50>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_7e76574670e40889980a481278db4c17.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e76574670e40889980a481278db4c17.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca1f5210>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_2725e09d35b1d14aa372c2545f277ed6.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_2725e09d35b1d14aa372c2545f277ed6.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca100290>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_edf32f88cc593645805ac78b8e5eff1a.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_edf32f88cc593645805ac78b8e5eff1a.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefca245190>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fefc9224c90>
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F6b%252F7b6bcb9fb5ff3ab0d74e8e1d31ffa01f%252Fpa%252FAN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg saved to cache
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 503bf05f-2059-53b1-a460-cdc89b2696f6
2026-03-30 12:29:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 503bf05f-2059-53b1-a460-cdc89b2696f6, skipping ID generation
2026-03-30 12:29:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503bf05f-2059-53b1-a460-cdc89b2696f6 with scrape type 1
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 503bf05f-2059-53b1-a460-cdc89b2696f6 sending to next pipeline
2026-03-30 12:29:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 503bf05f-2059-53b1-a460-cdc89b2696f6, identifier: AN07347
2026-03-30 12:29:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 503bf05f-2059-53b1-a460-cdc89b2696f6 with identifier: AN07347
2026-03-30 12:29:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 503bf05f-2059-53b1-a460-cdc89b2696f6 with identifier: AN07347
2026-03-30 12:29:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 503bf05f-2059-53b1-a460-cdc89b2696f6 with identifier: AN07347 to the API
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:55:02Z',
'fuel_type': 'diesel',
'id': '503bf05f-2059-53b1-a460-cdc89b2696f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN07347',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 196660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7ab46515b522104a520ca165acfc5c6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_26d7356cc1bbc91aba6fc6eb9540604a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e064309280e44a6c2b4ce3599fa3124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_852bb83e3da7f38f36bbe45784ae1294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_edf32f88cc593645805ac78b8e5eff1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_7e76574670e40889980a481278db4c17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_2725e09d35b1d14aa372c2545f277ed6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_35521c4c1e1a288ec582ad644d00b4d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_3ce5babed0d715c06dcad5e51fa586f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503bf05f-2059-53b1-a460-cdc89b2696f6/503bf05f-2059-53b1-a460-cdc89b2696f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/6b/7b6bcb9fb5ff3ab0d74e8e1d31ffa01f/pa/AN07347_b0196231d6d8dd91383f085f82ebfd9f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueEfficiency',
'transmission': 'manual',
'trim': 'T BlueEfficiency',
'year': 2014}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN07347%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.fr] INFO: Saving data for AN07347: {'created_time': 1774873753.859188, 'last_price_update_time': 1774873753.859199, 'auction_closing_time': 1774972502.0}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN07347') HTTP/1.1" 204 0
2026-03-30 12:29:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:14 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 5767 | hits on page: 40
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH01130%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for BH01130: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA87686%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for WA87686: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB80378%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for DB80378: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX11821%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for TX11821: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV35629%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for PV35629: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: NN99848
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: SS89133
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: VT37001
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT37001%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for VT37001: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: ZN87379
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: NV27506
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: GV52982
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV52982%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for GV52982: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: BN28756
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN28756%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for BN28756: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: AD91227
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: ZC95968
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC95968%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for ZC95968: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: XK83942
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: XK81760
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK81760%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for XK81760: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: EH51062
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH51062%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for EH51062: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: JY76757
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY76757%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for JY76757: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: AX22473
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: MZ41837
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: EF10438
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: XL94041
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: YA21876
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA21876%27 HTTP/1.1" 200 None
2026-03-30 12:29:14 [auto1.fr] INFO: Scrape type for YA21876: 0
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 12:29:14 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 12:29:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:22 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 5769 | hits on page: 40
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: GG22552
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: NN01775
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: CU28394
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: JK29705
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: SR20214
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: LT76736
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: LB48009
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: KH84545
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: VF20612
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF20612%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for VF20612: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: TG26507
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: NV80033
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: KJ05424
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ05424%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for KJ05424: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: GF80669
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP99731%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for XP99731: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: HC61208
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: VM65091
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: WY28346
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: RM38030
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: RB12134
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: BD87596
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: DK47228
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: KA87751
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: JA17926
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: VM16147
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: ER22788
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER22788%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for ER22788: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: KH57146
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: ZG90152
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: CP15038
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: WD39316
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: FE06802
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: KA87239
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA87239%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for KA87239: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: FR98174
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR98174%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.fr] INFO: Scrape type for FR98174: 0
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: PG03000
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: MB18852
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: GS75094
2026-03-30 12:29:22 [auto1.fr] INFO: Found listing with ID: ET15310
2026-03-30 12:29:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:23 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 5769 | hits on page: 40
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BX78480
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: CJ89974
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: WP13025
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP13025%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for WP13025: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: HV51188
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: ML28729
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML28729%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for ML28729: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BM94017
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: KR98838
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: CP37955
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: LJ18319
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: GR98034
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: MK42469
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: SL62587
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: PC27087
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: ZP95502
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: YT36285
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: XR02166
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR02166%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for XR02166: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BV69061
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: UC77970
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: DH30848
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN53755%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for CN53755: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: MR83440
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BK72121
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK72121%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for BK72121: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: KH85386
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: DH64426
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: NJ39357
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: VC57641
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC57641%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for VC57641: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: TY69433
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY69433%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for TY69433: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: NG03536
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: EL57210
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL57210%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for EL57210: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: FP49208
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BR79428
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR79428%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for BR79428: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: VS37711
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU81285%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for JU81285: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN02112%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for GN02112: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ82390%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.fr] INFO: Scrape type for KJ82390: 0
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 12:29:23 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 12:29:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:48 [scrapy.extensions.logstats] INFO: Crawled 281 pages (at 10 pages/min), scraped 214 items (at 6 items/min)
2026-03-30 12:29:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:00 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 5770 | hits on page: 40
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: DJ58290
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ58290%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for DJ58290: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: DX45828
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: RH58772
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: VZ61146
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: MB07680
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB07680%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for MB07680: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: PV49045
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV49045%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for PV49045: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: FV37446
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TP09076
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP09076%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for TP09076: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: EG55368
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: YK96178
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK96178%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for YK96178: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: RX28214
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX28214%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for RX28214: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: MM01049
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TU22359
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: SV83520
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV83520%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for SV83520: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: ZU71183
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TL43630
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: XL92817
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TC56491
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: NV76103
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: KV21640
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: KB61906
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: PA77686
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: SY29297
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: CF60384
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: BX52558
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: HM35105
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: HS81476
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TT94112
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: ZU29510
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: SX04652
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: BK23856
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: DT54800
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: PX14877
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: UR06829
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: TA74732
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: LD13478
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: GD92514
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD92514%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for GD92514: 0
2026-03-30 12:30:00 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL24790%27 HTTP/1.1" 200 None
2026-03-30 12:30:00 [auto1.fr] INFO: Scrape type for DL24790: 0
2026-03-30 12:30:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:12 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL24790%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for DL24790: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: FV10697
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: TU46522
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: CM07289
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: XG30202
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: AL74013
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL74013%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for AL74013: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: VS30684
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: TN98594
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN98594%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for TN98594: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: FX72814
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX72814%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for FX72814: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: EC55821
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC55821%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for EC55821: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: JJ80448
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: MJ43566
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ43566%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for MJ43566: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: ZZ19761
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ19761%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for ZZ19761: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: NS56484
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: UZ78191
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: GR61554
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR61554%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for GR61554: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: RD55039
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: SU67266
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU67266%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for SU67266: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: TY27143
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: CF24077
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF24077%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for CF24077: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: TW89495
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: GM82732
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: JR89101
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR89101%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for JR89101: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: PE76789
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: TM96159
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: EW80890
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: LA42071
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA42071%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for LA42071: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: NK60668
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: JC04729
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: WU38484
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: CH43272
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: BE87790
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: UL81175
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: PH43278
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: PG45287
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: XN84792
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: GU38048
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: LY30069
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: ZG81108
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG81108%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.fr] INFO: Scrape type for ZG81108: 0
2026-03-30 12:30:12 [auto1.fr] INFO: Found listing with ID: ZV53128
2026-03-30 12:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:13 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: JA85521
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: NN44286
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: YF90779
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: ZJ95567
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: FS13979
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS13979%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for FS13979: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: EG04160
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: TF56803
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: BK02644
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK02644%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for BK02644: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: KV99093
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: XP51935
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP51935%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for XP51935: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: ZH33585
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: BE56161
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE56161%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for BE56161: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: KG84776
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: RP02904
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP02904%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for RP02904: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: KV37155
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV37155%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for KV37155: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: RD69787
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: XP70683
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV40287%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for TV40287: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: MV30877
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV30877%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for MV30877: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: YD24944
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: UB44080
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB44080%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for UB44080: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: CY41732
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: JX53268
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: VJ25498
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: PH34253
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH34253%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for PH34253: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: ZY67756
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY67756%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for ZY67756: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: WE41857
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: HL16171
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: BG53255
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: MK81616
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: VL74516
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ98371%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for UJ98371: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: TP39004
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: VV06327
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: YV95357
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: CW97175
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW97175%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for CW97175: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: TZ76111
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ76111%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for TZ76111: 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: MR25927
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR25927%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for MR25927: 0
2026-03-30 12:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:14 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: EL79670
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: HF97027
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: DC78531
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: JC25064
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: HG95528
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: FX87997
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX87997%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for FX87997: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: FU18661
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU18661%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for FU18661: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: EE45585
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: UT20394
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: MX13044
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: EF63082
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: VX78818
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: AP09710
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP09710%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for AP09710: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: TT35591
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: RN36299
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN36299%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for RN36299: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: BH31485
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: EL93658
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: MU42358
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU42358%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for MU42358: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: BL12426
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: WZ54212
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: ZB04396
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: MA06902
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: WM34767
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: MZ22730
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: GR12789
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: BR89045
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR89045%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for BR89045: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: DU77787
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: KH06244
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: AT01769
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: BT62919
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: NY21368
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY21368%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for NY21368: 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: XH36862
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: GU34103
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: LW46673
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: ND89234
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: XS84278
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: DS91007
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: GE11364
2026-03-30 12:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:15 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: VY02503
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: TZ02960
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: NA76127
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA76127%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.fr] INFO: Scrape type for NA76127: 0
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: MJ09819
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: PD24885
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: TL76456
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL76456%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.fr] INFO: Scrape type for TL76456: 0
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: EZ26130
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: BM92439
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: TS19753
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS19753%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.fr] INFO: Scrape type for TS19753: 0
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: BD67200
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: FR00063
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: CN82695
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: JP18496
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: HA49256
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: RH62537
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH62537%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for RH62537: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: YY77064
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY77064%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for YY77064: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: PU50020
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU50020%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for PU50020: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: HL00485
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL00485%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for HL00485: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: EX77707
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: SZ69370
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ69370%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for SZ69370: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: ZK36934
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: YN55052
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: AB09197
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: LW26050
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW26050%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for LW26050: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: AP20381
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: CT46807
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT46807%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for CT46807: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: ED23855
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: HB74151
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: YF69984
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF69984%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for YF69984: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: PM43892
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM43892%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for PM43892: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: ZJ93568
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: EA40746
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA40746%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for EA40746: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: KG95545
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: DL27365
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL27365%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for DL27365: 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: LZ24855
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: LD43486
2026-03-30 12:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:17 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: ZA49650
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: GK39924
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: SU63674
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: CA16747
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: AR83930
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: CA24685
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: TD13797
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: LY83162
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY83162%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for LY83162: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: RM94276
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: PK06687
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: EG00883
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: VT21499
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT21499%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for VT21499: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: KM03386
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: GF24817
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF24817%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for GF24817: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: LM21992
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM21992%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for LM21992: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: MJ39952
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: UB50505
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB50505%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for UB50505: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: AX81873
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: JD11645
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: JZ73334
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: NF74996
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: BY79094
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: CY49772
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: ZP74906
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP74906%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for ZP74906: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: UT28849
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT28849%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for UT28849: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: HZ48160
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: SD16900
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: WB70972
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: GC25257
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: AW19486
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: JW96914
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF11596%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for NF11596: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA51668%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for WA51668: 0
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 12:30:17 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU13949%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.fr] INFO: Scrape type for XU13949: 0
2026-03-30 12:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:18 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: UD43738
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD43738%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for UD43738: 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: YB57255
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: TT51673
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT51673%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for TT51673: 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: AP91610
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: MG48887
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: FW94560
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW94560%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for FW94560: 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: ZZ88049
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: JD71808
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: ZP58765
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY35521%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for KY35521: 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: VN94368
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: SB34610
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: WD64082
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: WM66922
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: XB39561
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: FD08548
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: RJ05241
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: ZE84012
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE84012%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for ZE84012: 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: GP66530
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: YG18113
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: LL00787
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: TV66965
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: YF91947
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF91947%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.fr] INFO: Scrape type for YF91947: 0
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: CF64953
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: LX96530
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: VC72866
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: AW72987
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: NX24565
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX24565%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.fr] INFO: Scrape type for NX24565: 0
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: JR54529
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR54529%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.fr] INFO: Scrape type for JR54529: 0
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: TJ20151
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: EH91855
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: UP72076
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: CR64037
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR64037%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.fr] INFO: Scrape type for CR64037: 0
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: VP32926
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: SD52344
2026-03-30 12:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:20 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: AH27666
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: BK72500
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: AD80452
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: VF51675
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: HF01727
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: NZ06649
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: GF46246
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: XJ44372
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: ZC86979
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: SG18598
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: JJ02643
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: AR69869
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR69869%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for AR69869: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: DA80805
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: SE67845
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: PR33870
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: LD85442
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: HH88390
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: ZZ73666
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: HB02679
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: LA59879
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: RM50552
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: GC31391
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: CY61543
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY61543%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for CY61543: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: RG55649
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: WU20781
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU20781%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for WU20781: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: RT86658
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT86658%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for RT86658: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: SJ36026
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ23398%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for DJ23398: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: UY92063
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: TU81762
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: NA46359
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT15844%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for ZT15844: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: HC15132
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: AK73885
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: ZN81951
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: SA63680
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA63680%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for SA63680: 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: UX42544
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: BK74323
2026-03-30 12:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:22 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UZ07675
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: TX49254
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX49254%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for TX49254: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UT17520
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: ML75206
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: VJ46136
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ46136%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for VJ46136: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UY44160
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY44160%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for UY44160: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: HM45390
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: MC14213
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: KJ36885
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ36885%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for KJ36885: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: PU11656
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: LL21207
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: ET58165
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: ZP18872
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP18872%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for ZP18872: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: VL26218
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: KM29309
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM29309%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for KM29309: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: SM81810
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: GD96207
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: NH35726
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: RZ50801
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UN32467
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN32467%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for UN32467: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: PP18187
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: CF93348
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UT91151
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: HG74686
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: JM16652
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: UZ43867
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ43867%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for UZ43867: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: TY39394
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: NM34809
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: LM74101
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: BX20872
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: DN01805
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN01805%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for DN01805: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: MD23469
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD23469%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for MD23469: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: XL24411
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: AL18302
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL18302%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for AL18302: 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: PR14744
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: KR92660
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: BA37950
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC27822%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for YC27822: 0
2026-03-30 12:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:48 [scrapy.extensions.logstats] INFO: Crawled 290 pages (at 9 pages/min), scraped 214 items (at 0 items/min)
2026-03-30 12:30:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:55 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC27822%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for YC27822: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: EZ24123
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ24123%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for EZ24123: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: GB07314
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB07314%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for GB07314: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: JJ56309
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ56309%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for JJ56309: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: CW74569
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: CZ19931
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: LW56484
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: BP57483
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: FF46254
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: VC85970
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: NN90836
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: PX69189
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: HC09349
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: NT78881
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT78881%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for NT78881: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: KJ34319
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: GD98920
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: BL97827
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: SN72375
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: AF50767
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: TD82166
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: LL67655
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: DT73802
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: UR16491
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: UF85890
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF85890%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for UF85890: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: HF06911
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF06911%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for HF06911: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: YK42959
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: LB87950
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: WJ25626
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: WA74870
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: KC26562
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: PG06825
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: GM18501
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM18501%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for GM18501: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: JA07941
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: UD86149
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: FU06277
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: VZ89988
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ89988%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for VZ89988: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: SH02811
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH02811%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for SH02811: 0
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: MJ04505
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: RJ04391
2026-03-30 12:30:55 [auto1.fr] INFO: Found listing with ID: TC15970
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC15970%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.fr] INFO: Scrape type for TC15970: 0
2026-03-30 12:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:56 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: MD03627
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: LG69185
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG69185%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for LG69185: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: AW56765
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: MX55612
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX55612%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for MX55612: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: XR55930
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: TT62412
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: GP20665
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP20665%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for GP20665: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: XF66924
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF66924%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for XF66924: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: HC72507
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: ML81854
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML81854%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for ML81854: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: ME64971
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: HD73220
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD73220%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for HD73220: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: WY65543
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY65543%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for WY65543: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: PP88505
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: MR10155
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: JF58444
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF58444%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.fr] INFO: Scrape type for JF58444: 0
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: BP08934
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: WZ16203
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: DJ15962
2026-03-30 12:30:56 [auto1.fr] INFO: Found listing with ID: RY35148
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY35148%27 HTTP/1.1" 200 None
2026-03-30 12:30:57 [auto1.fr] INFO: Scrape type for RY35148: 0
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: RZ14627
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: WL88981
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: NE74351
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: KK28971
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: WJ27946
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: WU93309
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: VY61935
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY61935%27 HTTP/1.1" 200 None
2026-03-30 12:30:57 [auto1.fr] INFO: Scrape type for VY61935: 0
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: AH64815
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: YH52342
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: ZF71458
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: AS01327
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: MK61341
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK61341%27 HTTP/1.1" 200 None
2026-03-30 12:30:57 [auto1.fr] INFO: Scrape type for MK61341: 0
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: YF77818
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: YK09697
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK09697%27 HTTP/1.1" 200 None
2026-03-30 12:30:57 [auto1.fr] INFO: Scrape type for YK09697: 0
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: RA45535
2026-03-30 12:30:57 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG75873%27 HTTP/1.1" 200 None
2026-03-30 12:30:57 [auto1.fr] INFO: Scrape type for RG75873: 0
2026-03-30 12:30:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:05 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG75873%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for RG75873: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: YC64262
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC64262%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for YC64262: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: US02346
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: VS91787
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: HL50910
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: BK19685
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: JE71016
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: JA39798
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA39798%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for JA39798: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: GT00876
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT00876%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for GT00876: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: AL46960
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: YR53014
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR53014%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for YR53014: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: WB17402
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB17402%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for WB17402: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: VC26390
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: SZ19354
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: DY80869
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: ED61493
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: TJ13454
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: YE95249
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE95249%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for YE95249: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: DS19828
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: BD81949
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: HS13722
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS13722%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for HS13722: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: ML02900
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: RK77982
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: BE67989
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: YH76503
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: ZG89703
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: HM47617
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: TL49010
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL49010%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for TL49010: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: VF62487
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: KF52114
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF52114%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for KF52114: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: SA43115
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: UV73863
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: XL20075
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL20075%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for XL20075: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: ER09200
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: GP11392
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: KG49901
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: UD61888
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: RM00164
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: AS36390
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS36390%27 HTTP/1.1" 200 None
2026-03-30 12:31:05 [auto1.fr] INFO: Scrape type for AS36390: 0
2026-03-30 12:31:05 [auto1.fr] INFO: Found listing with ID: KU90889
2026-03-30 12:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:09 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: VG73746
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: AL35462
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: NJ66482
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: NW52748
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: EP29644
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP29644%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for EP29644: 0
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: NS68677
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: KY89343
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: AC64067
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: SR76530
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: EB39738
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: BU00959
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY32369%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for CY32369: 0
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: NK57774
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: SV53673
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: EV92409
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: NM58837
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: KP42994
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP42994%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for KP42994: 0
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: KZ71097
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: RC67764
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: HR35316
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: XL60481
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: FB22935
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: ZM82858
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: SB76672
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB76672%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for SB76672: 0
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: XJ36230
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: VE53658
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: XY31555
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: SY35677
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: VW72716
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: DZ82419
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: KX23637
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: XU30024
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: FU08159
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: VU97414
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: DT80486
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: WM52776
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: RP20304
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: TW57421
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW57421%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for TW57421: 0
2026-03-30 12:31:09 [auto1.fr] INFO: Found listing with ID: YJ41205
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ41205%27 HTTP/1.1" 200 None
2026-03-30 12:31:09 [auto1.fr] INFO: Scrape type for YJ41205: 0
2026-03-30 12:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:11 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: RC17389
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: TR32584
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: MF63659
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: XG61570
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: WP40871
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP40871%27 HTTP/1.1" 200 None
2026-03-30 12:31:11 [auto1.fr] INFO: Scrape type for WP40871: 0
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: EZ02912
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: MM27553
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: XA54724
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA54724%27 HTTP/1.1" 200 None
2026-03-30 12:31:11 [auto1.fr] INFO: Scrape type for XA54724: 0
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: LE66923
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: SB40125
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: GP95041
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP95041%27 HTTP/1.1" 200 None
2026-03-30 12:31:11 [auto1.fr] INFO: Scrape type for GP95041: 0
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: CZ77892
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ77892%27 HTTP/1.1" 200 None
2026-03-30 12:31:11 [auto1.fr] INFO: Scrape type for CZ77892: 0
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: VR30765
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: TG40570
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: HD96935
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: ZX14325
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: WH09116
2026-03-30 12:31:11 [auto1.fr] INFO: Found listing with ID: YU99421
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU99421%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for YU99421: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: TT80789
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: TV87876
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: PV47971
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: XG32357
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG32357%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for XG32357: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: BB56606
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: NH32818
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: LZ87734
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: YG68937
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: FX00689
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: CZ00697
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ00697%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for CZ00697: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: BC53965
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: NC54891
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC54891%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for NC54891: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: LP57599
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: CB31058
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB31058%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for CB31058: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: UN80440
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: YV99261
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: EZ77748
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: RP24230
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: UX03179
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD23004%27 HTTP/1.1" 200 None
2026-03-30 12:31:12 [auto1.fr] INFO: Scrape type for DD23004: 0
2026-03-30 12:31:12 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 12:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:23 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF00056%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for YF00056: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY17691%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for RY17691: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: US33967
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: LM27279
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM27279%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for LM27279: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FM08864
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: RV55233
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV55233%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for RV55233: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FE50003
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: US09137
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: WB86369
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: KB61769
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: AA82428
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FC34806
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC34806%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for FC34806: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: HD23941
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: UG12644
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG12644%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for UG12644: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: DF97740
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK91904%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for KK91904: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GV16284
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV16284%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for GV16284: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: CH91166
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH91166%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for CH91166: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV13261%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for GV13261: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD19719%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for AD19719: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: UZ91010
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: SL05897
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: UG53294
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG53294%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for UG53294: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: RY43712
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: EU28848
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU28848%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for EU28848: 0
2026-03-30 12:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:30 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: LG77466
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: CR73549
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: DU99453
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: MS42511
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: LE66377
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: XS52367
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: DV55941
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JD19463
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: WB51756
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: MH16363
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: KK35444
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JC79144
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JA97388
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: AH02524
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: GY97445
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: NR32441
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: PA02750
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA02750%27 HTTP/1.1" 200 None
2026-03-30 12:31:30 [auto1.fr] INFO: Scrape type for PA02750: 0
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: SC90011
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: DJ04240
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JR92262
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: CZ59485
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: LJ50590
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: AX20284
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: DT57563
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT57563%27 HTTP/1.1" 200 None
2026-03-30 12:31:30 [auto1.fr] INFO: Scrape type for DT57563: 0
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: LA97865
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: WW85348
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA31656%27 HTTP/1.1" 200 None
2026-03-30 12:31:30 [auto1.fr] INFO: Scrape type for JA31656: 0
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: VN06433
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: MR60637
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR60637%27 HTTP/1.1" 200 None
2026-03-30 12:31:30 [auto1.fr] INFO: Scrape type for MR60637: 0
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: UK47887
2026-03-30 12:31:30 [auto1.fr] INFO: Found listing with ID: AU99962
2026-03-30 12:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:31 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: FF11603
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: PU35447
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU35447%27 HTTP/1.1" 200 None
2026-03-30 12:31:31 [auto1.fr] INFO: Scrape type for PU35447: 0
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: SB24854
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB24854%27 HTTP/1.1" 200 None
2026-03-30 12:31:31 [auto1.fr] INFO: Scrape type for SB24854: 0
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: GN79133
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: CR56365
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: HV80802
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: RW72165
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW72165%27 HTTP/1.1" 200 None
2026-03-30 12:31:31 [auto1.fr] INFO: Scrape type for RW72165: 0
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: TS50900
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: WT80779
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: NY88929
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: BP08503
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: TU98697
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: DP24552
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP24552%27 HTTP/1.1" 200 None
2026-03-30 12:31:31 [auto1.fr] INFO: Scrape type for DP24552: 0
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: DC92769
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: LB88529
2026-03-30 12:31:31 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU88494%27 HTTP/1.1" 200 None
2026-03-30 12:31:32 [auto1.fr] INFO: Scrape type for RU88494: 0
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: WZ91976
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: YW24880
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: RD81906
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD81906%27 HTTP/1.1" 200 None
2026-03-30 12:31:32 [auto1.fr] INFO: Scrape type for RD81906: 0
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 12:31:32 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC12910%27 HTTP/1.1" 200 None
2026-03-30 12:31:32 [auto1.fr] INFO: Scrape type for XC12910: 0
2026-03-30 12:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:33 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED30549%27 HTTP/1.1" 200 None
2026-03-30 12:31:33 [auto1.fr] INFO: Scrape type for ED30549: 0
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD37120%27 HTTP/1.1" 200 None
2026-03-30 12:31:33 [auto1.fr] INFO: Scrape type for TD37120: 0
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS03544%27 HTTP/1.1" 200 None
2026-03-30 12:31:33 [auto1.fr] INFO: Scrape type for PS03544: 0
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 12:31:33 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU95622%27 HTTP/1.1" 200 None
2026-03-30 12:31:33 [auto1.fr] INFO: Scrape type for TU95622: 2
2026-03-30 12:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 161814a1-6d35-574d-8f27-0ead235cba4f with identifier: TU95622
2026-03-30 12:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 161814a1-6d35-574d-8f27-0ead235cba4f with scrape type 2
2026-03-30 12:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 161814a1-6d35-574d-8f27-0ead235cba4f with scrape type 2
2026-03-30 12:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 161814a1-6d35-574d-8f27-0ead235cba4f, identifier: TU95622
2026-03-30 12:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 161814a1-6d35-574d-8f27-0ead235cba4f with identifier: TU95622
2026-03-30 12:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 161814a1-6d35-574d-8f27-0ead235cba4f with identifier: TU95622
2026-03-30 12:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 161814a1-6d35-574d-8f27-0ead235cba4f with identifier: TU95622 to the API
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:18:01Z',
'fuel_type': 'petrol',
'id': '161814a1-6d35-574d-8f27-0ead235cba4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU95622',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 51601,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-07',
'seller_name': None,
'title': 'MINI Cooper John Cooper Works Trim',
'transmission': 'automatic',
'trim': 'John Works Trim',
'year': 2023}
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU95622%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Saving data for TU95622: {'auction_closing_time': 1774883881.0, 'created_time': 1774440199.149722, 'last_price_update_time': 1774873894.102407}
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU95622') HTTP/1.1" 204 0
2026-03-30 12:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN27174%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for UN27174: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ23604%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for PZ23604: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX02215%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for VX02215: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE64469%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for JE64469: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB61195%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for LB61195: 0
2026-03-30 12:31:48 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 9 pages/min), scraped 215 items (at 1 items/min)
2026-03-30 12:31:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:55 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 5775 | hits on page: 40
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB61195%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for LB61195: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH59427%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for VH59427: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES00688%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for ES00688: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX77724%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for KX77724: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK64149%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for RK64149: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS85289%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for GS85289: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF49092%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for YF49092: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK74107%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for FK74107: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR63373%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for XR63373: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV44924%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for EV44924: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS97148%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for AS97148: 0
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 12:31:55 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH74389%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.fr] INFO: Scrape type for RH74389: 0
2026-03-30 12:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:27 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV44924%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for EV44924: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS97148%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for AS97148: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH74389%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for RH74389: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU68611%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for BU68611: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY60443%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for LY60443: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY05903%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.fr] INFO: Scrape type for XY05903: 0
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 12:32:27 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 12:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:29 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM88009%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for RM88009: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH07724%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for ZH07724: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET80426%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for ET80426: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM98474%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for HM98474: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP27331%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for CP27331: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT87361%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for DT87361: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC80653%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for KC80653: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH76438%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for PH76438: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH05370%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.fr] INFO: Scrape type for VH05370: 0
2026-03-30 12:32:29 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 12:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:46 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE94159%27 HTTP/1.1" 200 None
2026-03-30 12:32:46 [auto1.fr] INFO: Scrape type for ZE94159: 0
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF52157%27 HTTP/1.1" 200 None
2026-03-30 12:32:46 [auto1.fr] INFO: Scrape type for TF52157: 0
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK90756%27 HTTP/1.1" 200 None
2026-03-30 12:32:46 [auto1.fr] INFO: Scrape type for FK90756: 0
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG78208%27 HTTP/1.1" 200 None
2026-03-30 12:32:46 [auto1.fr] INFO: Scrape type for XG78208: 0
2026-03-30 12:32:46 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF83013%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for JF83013: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD76291%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for TD76291: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR66556%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for CR66556: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE39822%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for CE39822: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ71258%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for PJ71258: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD39167%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for SD39167: 0
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 12:32:47 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG70270%27 HTTP/1.1" 200 None
2026-03-30 12:32:47 [auto1.fr] INFO: Scrape type for HG70270: 0
2026-03-30 12:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:48 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN71297%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for WN71297: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS59441%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for BS59441: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY58185%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for WY58185: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF82248%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for CF82248: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF18063%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for SF18063: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX67130%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for MX67130: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR29296%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for ZR29296: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU45588%27 HTTP/1.1" 200 None
2026-03-30 12:32:48 [auto1.fr] INFO: Scrape type for DU45588: 0
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: DE97163
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 12:32:48 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 12:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:48 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 5 pages/min), scraped 215 items (at 0 items/min)
2026-03-30 12:32:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:49 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET87110%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for ET87110: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ15243%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for MJ15243: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN20947%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for BN20947: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV51359%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for FV51359: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP70833%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for YP70833: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC77487%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for FC77487: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM94838%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for WM94838: 0
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 12:32:49 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB86728%27 HTTP/1.1" 200 None
2026-03-30 12:32:49 [auto1.fr] INFO: Scrape type for NB86728: 0
2026-03-30 12:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:50 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA01583%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for DA01583: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ56245%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for AJ56245: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF38524%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for BF38524: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL96546%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for GL96546: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ21713%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for BJ21713: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA19714%27 HTTP/1.1" 200 None
2026-03-30 12:32:50 [auto1.fr] INFO: Scrape type for FA19714: 0
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 12:32:50 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 12:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:52 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE46852%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for RE46852: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB40606%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for MB40606: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ67075%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for FZ67075: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET77634%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for ET77634: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK99343%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for JK99343: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB19718%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for BB19718: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN44054%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for RN44054: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: FM45887
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU86192%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for PU86192: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB93727%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for XB93727: 0
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 12:32:52 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS28522%27 HTTP/1.1" 200 None
2026-03-30 12:32:52 [auto1.fr] INFO: Scrape type for SS28522: 0
2026-03-30 12:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:00 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS28522%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for SS28522: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA53599%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for GA53599: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE18258%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for TE18258: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL32198%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for RL32198: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT69522%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for DT69522: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL35508%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for YL35508: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU62786%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for EU62786: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN91835%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for PN91835: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS38790%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for CS38790: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP58088%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for ZP58088: 0
2026-03-30 12:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:02 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF12367%27 HTTP/1.1" 200 None
2026-03-30 12:33:02 [auto1.fr] INFO: Scrape type for CF12367: 0
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR86922%27 HTTP/1.1" 200 None
2026-03-30 12:33:02 [auto1.fr] INFO: Scrape type for ZR86922: 0
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY57669%27 HTTP/1.1" 200 None
2026-03-30 12:33:02 [auto1.fr] INFO: Scrape type for RY57669: 0
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 12:33:02 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC44754%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for BC44754: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP40309%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for UP40309: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN73019%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for FN73019: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU96454%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for GU96454: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH01307%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for RH01307: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU36463%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for NU36463: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC64672%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for SC64672: 0
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 12:33:03 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR04553%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.fr] INFO: Scrape type for WR04553: 0
2026-03-30 12:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:05 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR52177%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for ZR52177: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA63031%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for FA63031: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB94788%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for TB94788: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP29660%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for MP29660: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC67193%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for SC67193: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN87859%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for YN87859: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF95017%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for LF95017: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE07109%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for ZE07109: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD51502%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for ZD51502: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT07669%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for DT07669: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP77756%27 HTTP/1.1" 200 None
2026-03-30 12:33:05 [auto1.fr] INFO: Scrape type for NP77756: 0
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 12:33:05 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 12:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:48 [scrapy.extensions.logstats] INFO: Crawled 310 pages (at 6 pages/min), scraped 215 items (at 0 items/min)
2026-03-30 12:33:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:50 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 5786 | hits on page: 40
2026-03-30 12:33:50 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 12:33:50 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 12:33:50 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 12:33:50 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 12:33:50 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL57355%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for TL57355: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK00168%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for UK00168: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR91746%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for LR91746: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR80712%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for JR80712: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE28877%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for ZE28877: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE65745%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for BE65745: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR50266%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for TR50266: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK33174%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for NK33174: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU74521%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for TU74521: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH03799%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for ZH03799: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA82940%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for CA82940: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN62809%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for SN62809: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE25024%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for JE25024: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF35893%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for LF35893: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT19328%27 HTTP/1.1" 200 None
2026-03-30 12:33:51 [auto1.fr] INFO: Scrape type for XT19328: 0
2026-03-30 12:33:51 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 12:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:07 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 5787 | hits on page: 40
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU18258%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.fr] INFO: Scrape type for AU18258: 0
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC63530%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.fr] INFO: Scrape type for JC63530: 0
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC77336%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.fr] INFO: Scrape type for PC77336: 0
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN09672%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.fr] INFO: Scrape type for SN09672: 0
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY72155%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.fr] INFO: Scrape type for NY72155: 0
2026-03-30 12:34:07 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME98781%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for ME98781: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD43260%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for KD43260: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH47501%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for AH47501: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC87017%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for AC87017: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC92691%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for JC92691: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ34092%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for VJ34092: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV46640%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.fr] INFO: Scrape type for CV46640: 0
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 12:34:08 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 12:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:48 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 2 pages/min), scraped 215 items (at 0 items/min)
2026-03-30 12:34:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:19 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 5792 | hits on page: 40
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV46640%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for CV46640: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY35541%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for CY35541: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW25669%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for EW25669: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC30245%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for NC30245: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD32912%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for LD32912: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH74001%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for GH74001: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU00205%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for PU00205: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG04069%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for GG04069: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE42502%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for JE42502: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE21406%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.fr] INFO: Scrape type for GE21406: 0
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 12:35:19 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 12:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:24 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 5793 | hits on page: 40
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK21220%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for FK21220: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM91807%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for JM91807: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ44526%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for BZ44526: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ18197%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for XJ18197: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK47004%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for WK47004: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB35100%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for RB35100: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH03582%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for PH03582: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG44666%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for LG44666: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK53270%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for FK53270: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS50473%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for JS50473: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP08124%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for LP08124: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG77796%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for NG77796: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW97014%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for FW97014: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK62670%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for NK62670: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ70385%27 HTTP/1.1" 200 None
2026-03-30 12:35:24 [auto1.fr] INFO: Scrape type for XZ70385: 0
2026-03-30 12:35:24 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 12:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:44 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 5796 | hits on page: 40
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK62670%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for NK62670: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ70385%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for XZ70385: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK29548%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for LK29548: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF81227%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for CF81227: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW80983%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for LW80983: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE03173%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for JE03173: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL60402%27 HTTP/1.1" 200 None
2026-03-30 12:35:44 [auto1.fr] INFO: Scrape type for BL60402: 0
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 12:35:44 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ82323%27 HTTP/1.1" 200 None
2026-03-30 12:35:45 [auto1.fr] INFO: Scrape type for JZ82323: 0
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY23832%27 HTTP/1.1" 200 None
2026-03-30 12:35:45 [auto1.fr] INFO: Scrape type for HY23832: 0
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC64518%27 HTTP/1.1" 200 None
2026-03-30 12:35:45 [auto1.fr] INFO: Scrape type for VC64518: 0
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF07976%27 HTTP/1.1" 200 None
2026-03-30 12:35:45 [auto1.fr] INFO: Scrape type for DF07976: 0
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 12:35:45 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 12:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:48 [scrapy.extensions.logstats] INFO: Crawled 315 pages (at 3 pages/min), scraped 215 items (at 0 items/min)
2026-03-30 12:35:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:49 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 5796 | hits on page: 40
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE65040%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for AE65040: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR79626%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for WR79626: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ98417%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for DZ98417: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP13709%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for LP13709: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN50039%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for DN50039: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB13135%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for FB13135: 0
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 12:35:49 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK02389%27 HTTP/1.1" 200 None
2026-03-30 12:35:49 [auto1.fr] INFO: Scrape type for PK02389: 2
2026-03-30 12:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-03-30 12:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with scrape type 2
2026-03-30 12:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with scrape type 2
2026-03-30 12:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68ba7d46-0b17-5aa5-8cee-132abb0a7003, identifier: PK02389
2026-03-30 12:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-03-30 12:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-03-30 12:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389 to the API
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:31:29Z',
'fuel_type': 'diesel',
'id': '68ba7d46-0b17-5aa5-8cee-132abb0a7003',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK02389',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 161493,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Executive',
'transmission': 'automatic',
'trim': '4Matic Executive',
'year': 2016}
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK02389%27 HTTP/1.1" 200 None
2026-03-30 12:35:50 [auto1.fr] INFO: Saving data for PK02389: {'auction_closing_time': 1774884689.0, 'created_time': 1773953704.325049, 'last_price_update_time': 1774874150.462667}
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK02389') HTTP/1.1" 204 0
2026-03-30 12:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS80497%27 HTTP/1.1" 200 None
2026-03-30 12:35:50 [auto1.fr] INFO: Scrape type for DS80497: 0
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR21858%27 HTTP/1.1" 200 None
2026-03-30 12:35:50 [auto1.fr] INFO: Scrape type for UR21858: 0
2026-03-30 12:35:50 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 12:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:59 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 5796 | hits on page: 40
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG18417%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for MG18417: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY80377%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for KY80377: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP67901%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for LP67901: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX46082%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for DX46082: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN48581%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for BN48581: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE39264%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for RE39264: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH99272%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for HH99272: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC16788%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for NC16788: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA53097%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for FA53097: 0
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 12:35:59 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL69311%27 HTTP/1.1" 200 None
2026-03-30 12:35:59 [auto1.fr] INFO: Scrape type for SL69311: 0
2026-03-30 12:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:20 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 5798 | hits on page: 40
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL69311%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for SL69311: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY63806%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for RY63806: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC56122%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for LC56122: 2
2026-03-30 12:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd46366a-eb57-51f4-b6fe-14d626d321aa with identifier: LC56122
2026-03-30 12:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd46366a-eb57-51f4-b6fe-14d626d321aa with scrape type 2
2026-03-30 12:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd46366a-eb57-51f4-b6fe-14d626d321aa with scrape type 2
2026-03-30 12:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd46366a-eb57-51f4-b6fe-14d626d321aa, identifier: LC56122
2026-03-30 12:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd46366a-eb57-51f4-b6fe-14d626d321aa with identifier: LC56122
2026-03-30 12:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd46366a-eb57-51f4-b6fe-14d626d321aa with identifier: LC56122
2026-03-30 12:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd46366a-eb57-51f4-b6fe-14d626d321aa with identifier: LC56122 to the API
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:55:14Z',
'fuel_type': 'hybrid',
'id': 'fd46366a-eb57-51f4-b6fe-14d626d321aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC56122',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 59167,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-07',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC56122%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Saving data for LC56122: {'auction_closing_time': 1774886114.0, 'created_time': 1774599355.769826, 'last_price_update_time': 1774874180.737714}
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LC56122') HTTP/1.1" 204 0
2026-03-30 12:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY59301%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for ZY59301: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP53997%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for AP53997: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH24592%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for AH24592: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA45962%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for CA45962: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF46494%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for UF46494: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA61938%27 HTTP/1.1" 200 None
2026-03-30 12:36:20 [auto1.fr] INFO: Scrape type for PA61938: 0
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 12:36:20 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 12:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:37 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 5797 | hits on page: 40
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR13721%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for UR13721: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG00729%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for JG00729: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS92279%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for KS92279: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US68134%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for US68134: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU02451%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for EU02451: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF36841%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.fr] INFO: Scrape type for BF36841: 0
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 12:36:37 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 12:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:39 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 5797 | hits on page: 40
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX82402%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for LX82402: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX17259%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for DX17259: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE27506%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for ZE27506: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE93538%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for VE93538: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP09228%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for YP09228: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY75523%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for CY75523: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK03845%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for VK03845: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR52033%27 HTTP/1.1" 200 None
2026-03-30 12:36:39 [auto1.fr] INFO: Scrape type for LR52033: 0
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 12:36:39 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 12:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:48 [scrapy.extensions.logstats] INFO: Crawled 320 pages (at 5 pages/min), scraped 217 items (at 2 items/min)
2026-03-30 12:36:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:37:48 [scrapy.extensions.logstats] INFO: Crawled 320 pages (at 0 pages/min), scraped 217 items (at 0 items/min)
2026-03-30 12:37:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:51 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 5801 | hits on page: 40
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR52033%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for LR52033: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN65032%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for DN65032: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV37722%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for HV37722: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ41909%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for EZ41909: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK53138%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for XK53138: 2
2026-03-30 12:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 588bfa11-2973-5c52-a40c-15b9623506a3 with identifier: XK53138
2026-03-30 12:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 588bfa11-2973-5c52-a40c-15b9623506a3 with scrape type 2
2026-03-30 12:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 588bfa11-2973-5c52-a40c-15b9623506a3 with scrape type 2
2026-03-30 12:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 588bfa11-2973-5c52-a40c-15b9623506a3, identifier: XK53138
2026-03-30 12:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 588bfa11-2973-5c52-a40c-15b9623506a3 with identifier: XK53138
2026-03-30 12:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 588bfa11-2973-5c52-a40c-15b9623506a3 with identifier: XK53138
2026-03-30 12:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 588bfa11-2973-5c52-a40c-15b9623506a3 with identifier: XK53138 to the API
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:36:31Z',
'fuel_type': 'petrol',
'id': '588bfa11-2973-5c52-a40c-15b9623506a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK53138',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 130439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-27',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK53138%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Saving data for XK53138: {'auction_closing_time': 1774884991.0, 'created_time': 1774599324.636951, 'last_price_update_time': 1774874271.666902}
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK53138') HTTP/1.1" 204 0
2026-03-30 12:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD60690%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for AD60690: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ49135%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for SJ49135: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM80077%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for SM80077: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW69486%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for LW69486: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE08410%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for RE08410: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL80996%27 HTTP/1.1" 200 None
2026-03-30 12:37:51 [auto1.fr] INFO: Scrape type for BL80996: 0
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 12:37:51 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 12:38:48 [scrapy.extensions.logstats] INFO: Crawled 321 pages (at 1 pages/min), scraped 218 items (at 1 items/min)
2026-03-30 12:38:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:39:48 [scrapy.extensions.logstats] INFO: Crawled 321 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 12:39:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:40:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.488(s), this was the 1st time calling it.
2026-03-30 12:40:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.697093549811747 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:40:25 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 5813 | hits on page: 40
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW69486%27 HTTP/1.1" 200 None
2026-03-30 12:40:25 [auto1.fr] INFO: Scrape type for LW69486: 0
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE08410%27 HTTP/1.1" 200 None
2026-03-30 12:40:25 [auto1.fr] INFO: Scrape type for RE08410: 0
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL80996%27 HTTP/1.1" 200 None
2026-03-30 12:40:25 [auto1.fr] INFO: Scrape type for BL80996: 0
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 12:40:25 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX14323%27 HTTP/1.1" 200 None
2026-03-30 12:40:25 [auto1.fr] INFO: Scrape type for DX14323: 2
2026-03-30 12:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with identifier: DX14323
2026-03-30 12:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with scrape type 2
2026-03-30 12:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with scrape type 2
2026-03-30 12:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0965fbd9-09cc-565b-a8dd-39f9b861bf78, identifier: DX14323
2026-03-30 12:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with identifier: DX14323
2026-03-30 12:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with identifier: DX14323
2026-03-30 12:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0965fbd9-09cc-565b-a8dd-39f9b861bf78 with identifier: DX14323 to the API
2026-03-30 12:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:35:53Z',
'fuel_type': 'diesel',
'id': '0965fbd9-09cc-565b-a8dd-39f9b861bf78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX14323',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 199567,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-22',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro Ambition Luxe',
'transmission': 'automatic',
'trim': 'quattro Ambition Luxe',
'year': 2012}
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX14323%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Saving data for DX14323: {'auction_closing_time': 1774884953.0, 'created_time': 1773838767.084521, 'last_price_update_time': 1774874426.251434}
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DX14323') HTTP/1.1" 204 0
2026-03-30 12:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW78746%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for VW78746: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ20680%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for EJ20680: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW57453%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for CW57453: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF05657%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for FF05657: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM53916%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for DM53916: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW66058%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for EW66058: 0
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 12:40:26 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG44021%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Scrape type for ZG44021: 2
2026-03-30 12:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with identifier: ZG44021
2026-03-30 12:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with scrape type 2
2026-03-30 12:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with scrape type 2
2026-03-30 12:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770, identifier: ZG44021
2026-03-30 12:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with identifier: ZG44021
2026-03-30 12:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with identifier: ZG44021
2026-03-30 12:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770 with identifier: ZG44021 to the API
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:04:00Z',
'fuel_type': 'petrol',
'id': '2a6e16b7-3c03-5dc0-a92b-8b3f7eebc770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG44021',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 163591,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-19',
'seller_name': None,
'title': 'Peugeot 207 1.6 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG44021%27 HTTP/1.1" 200 None
2026-03-30 12:40:26 [auto1.fr] INFO: Saving data for ZG44021: {'auction_closing_time': 1774883040.0, 'created_time': 1774599352.216531, 'last_price_update_time': 1774874426.91476}
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG44021') HTTP/1.1" 204 0
2026-03-30 12:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:40:31 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 5813 | hits on page: 40
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ85085%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for ZZ85085: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU68004%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for DU68004: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK20365%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for DK20365: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY05301%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for WY05301: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ16592%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for HZ16592: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC41186%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for RC41186: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT24749%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for DT24749: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR16299%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for FR16299: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY01445%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for FY01445: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB71496%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for YB71496: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE66310%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for DE66310: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML39661%27 HTTP/1.1" 200 None
2026-03-30 12:40:31 [auto1.fr] INFO: Scrape type for ML39661: 0
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 12:40:31 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 12:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:40:33 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 5813 | hits on page: 40
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC27844%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for EC27844: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF67224%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for PF67224: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD22883%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for AD22883: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ71958%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for KJ71958: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN99416%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for JN99416: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR74514%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for NR74514: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH50907%27 HTTP/1.1" 200 None
2026-03-30 12:40:33 [auto1.fr] INFO: Scrape type for YH50907: 0
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 12:40:33 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 12:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ48204%27 HTTP/1.1" 200 None
2026-03-30 12:40:34 [auto1.fr] INFO: Scrape type for EZ48204: 0
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 12:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ36054%27 HTTP/1.1" 200 None
2026-03-30 12:40:34 [auto1.fr] INFO: Scrape type for DJ36054: 0
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 12:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB35212%27 HTTP/1.1" 200 None
2026-03-30 12:40:34 [auto1.fr] INFO: Scrape type for AB35212: 0
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 12:40:34 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 12:40:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:40:48 [scrapy.extensions.logstats] INFO: Crawled 324 pages (at 3 pages/min), scraped 220 items (at 2 items/min)
2026-03-30 12:40:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:41:07 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 5814 | hits on page: 40
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY57891%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for GY57891: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP97358%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for MP97358: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL62573%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for HL62573: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG79429%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for FG79429: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU49210%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for SU49210: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF68068%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for MF68068: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS19816%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for YS19816: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR21354%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for YR21354: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF56962%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for VF56962: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH20722%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for YH20722: 0
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 12:41:07 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ52352%27 HTTP/1.1" 200 None
2026-03-30 12:41:07 [auto1.fr] INFO: Scrape type for SJ52352: 0
2026-03-30 12:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:41:48 [scrapy.extensions.logstats] INFO: Crawled 325 pages (at 1 pages/min), scraped 220 items (at 0 items/min)
2026-03-30 12:41:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:42:48 [scrapy.extensions.logstats] INFO: Crawled 325 pages (at 0 pages/min), scraped 220 items (at 0 items/min)
2026-03-30 12:42:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:43:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.582(s), this was the 1st time calling it.
2026-03-30 12:43:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9436251705027443 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:43:41 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 5831 | hits on page: 40
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF68068%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for MF68068: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS19816%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for YS19816: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR21354%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for YR21354: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF56962%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for VF56962: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH20722%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for YH20722: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ52352%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for SJ52352: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR05983%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for KR05983: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD83043%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for BD83043: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB20661%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for FB20661: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY47803%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for XY47803: 0
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 12:43:41 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV01241%27 HTTP/1.1" 200 None
2026-03-30 12:43:41 [auto1.fr] INFO: Scrape type for VV01241: 0
2026-03-30 12:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:43:48 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 1 pages/min), scraped 220 items (at 0 items/min)
2026-03-30 12:43:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:43:58 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 5831 | hits on page: 40
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV75211%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for GV75211: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA06873%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for EA06873: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC26469%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for LC26469: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR67167%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for MR67167: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW10530%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for XW10530: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH69177%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for RH69177: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD95891%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for HD95891: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL66031%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for JL66031: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD00278%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for GD00278: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK07459%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for PK07459: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE39242%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for KE39242: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF82357%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for AF82357: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD84892%27 HTTP/1.1" 200 None
2026-03-30 12:43:58 [auto1.fr] INFO: Scrape type for PD84892: 0
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 12:43:58 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 12:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:44:00 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 5831 | hits on page: 40
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE76416%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for DE76416: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF32876%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for XF32876: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE54332%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for TE54332: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV69583%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for AV69583: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG30366%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for KG30366: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU10765%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for PU10765: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT22164%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for JT22164: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB31706%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for PB31706: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY36991%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for LY36991: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX50667%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for UX50667: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD62614%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for AD62614: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK61290%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for PK61290: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA14366%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for YA14366: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP24280%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for CP24280: 0
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 12:44:00 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH66103%27 HTTP/1.1" 200 None
2026-03-30 12:44:00 [auto1.fr] INFO: Scrape type for TH66103: 2
2026-03-30 12:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with identifier: TH66103
2026-03-30 12:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with scrape type 2
2026-03-30 12:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with scrape type 2
2026-03-30 12:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4, identifier: TH66103
2026-03-30 12:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with identifier: TH66103
2026-03-30 12:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with identifier: TH66103
2026-03-30 12:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4 with identifier: TH66103 to the API
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:52:23Z',
'fuel_type': 'petrol',
'id': 'b8c6c9b3-e4bc-589e-b6a1-cd9b80b1b6b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH66103',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 64747,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-16',
'seller_name': None,
'title': 'Citroen C1 1.0 VTi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2015}
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH66103%27 HTTP/1.1" 200 None
2026-03-30 12:44:01 [auto1.fr] INFO: Saving data for TH66103: {'auction_closing_time': 1774885943.0, 'created_time': 1774599325.421501, 'last_price_update_time': 1774874641.634345}
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH66103') HTTP/1.1" 204 0
2026-03-30 12:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 12:44:01 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 12:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:44:08 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 5832 | hits on page: 40
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ71859%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for AZ71859: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK39736%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for MK39736: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG14454%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for RG14454: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG65090%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for AG65090: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS99377%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for NS99377: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL99186%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for LL99186: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE44262%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for JE44262: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ93163%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for KJ93163: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA03447%27 HTTP/1.1" 200 None
2026-03-30 12:44:08 [auto1.fr] INFO: Scrape type for AA03447: 0
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 12:44:08 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 12:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:44:20 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 5835 | hits on page: 40
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA32444%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for EA32444: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX80921%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for KX80921: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT88401%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for WT88401: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB60197%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for BB60197: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH66193%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for WH66193: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG18910%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for FG18910: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW23641%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for AW23641: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF39350%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for WF39350: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ42359%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for UJ42359: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV44248%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for HV44248: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ16113%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for VJ16113: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK38255%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for HK38255: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB44516%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for FB44516: 0
2026-03-30 12:44:20 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN66374%27 HTTP/1.1" 200 None
2026-03-30 12:44:20 [auto1.fr] INFO: Scrape type for WN66374: 2
2026-03-30 12:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with identifier: WN66374
2026-03-30 12:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with scrape type 2
2026-03-30 12:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with scrape type 2
2026-03-30 12:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea, identifier: WN66374
2026-03-30 12:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with identifier: WN66374
2026-03-30 12:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with identifier: WN66374
2026-03-30 12:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4dc6f1f6-57d8-55a8-8111-5df8f374e6ea with identifier: WN66374 to the API
2026-03-30 12:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:10:01Z',
'fuel_type': 'petrol',
'id': '4dc6f1f6-57d8-55a8-8111-5df8f374e6ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN66374',
'listing': 'auction',
'make': 'Porsche',
'model': '911',
'odometer': 121025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-11-30',
'seller_name': None,
'title': 'Porsche 911 996 Carrera 4',
'transmission': 'manual',
'trim': 'Carrera 4',
'year': 1999}
2026-03-30 12:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN66374%27 HTTP/1.1" 200 None
2026-03-30 12:44:21 [auto1.fr] INFO: Saving data for WN66374: {'auction_closing_time': 1774883401.0, 'created_time': 1774599323.767637, 'last_price_update_time': 1774874661.182958}
2026-03-30 12:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN66374') HTTP/1.1" 204 0
2026-03-30 12:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:44:21 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 12:44:21 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 12:44:48 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 4 pages/min), scraped 222 items (at 2 items/min)
2026-03-30 12:44:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:45:38 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 5840 | hits on page: 40
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB44516%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for FB44516: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN66374%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for WN66374: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB27018%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for KB27018: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP93037%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for EP93037: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV82237%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for RV82237: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX76031%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for ZX76031: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM00251%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for XM00251: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV30475%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for PV30475: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN44572%27 HTTP/1.1" 200 None
2026-03-30 12:45:38 [auto1.fr] INFO: Scrape type for EN44572: 0
2026-03-30 12:45:38 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 12:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:45:48 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 1 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 12:45:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:45:59 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 5843 | hits on page: 40
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN44572%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for EN44572: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU83359%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for GU83359: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY58026%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for CY58026: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE89034%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for XE89034: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN45068%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for MN45068: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB50972%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for MB50972: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB54431%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for HB54431: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD92419%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for KD92419: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX27551%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for RX27551: 0
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 12:45:59 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY95378%27 HTTP/1.1" 200 None
2026-03-30 12:45:59 [auto1.fr] INFO: Scrape type for CY95378: 0
2026-03-30 12:45:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:46:07 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 5843 | hits on page: 40
2026-03-30 12:46:07 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 12:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR40793%27 HTTP/1.1" 200 None
2026-03-30 12:46:07 [auto1.fr] INFO: Scrape type for CR40793: 0
2026-03-30 12:46:07 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 12:46:07 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 12:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC48292%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for EC48292: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ34365%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for SZ34365: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB20094%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for GB20094: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK25648%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for YK25648: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV64088%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for PV64088: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ71794%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for JZ71794: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH09710%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for NH09710: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL72206%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for YL72206: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ14253%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for VZ14253: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV62739%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for RV62739: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL47353%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for RL47353: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA80811%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for JA80811: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA63272%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for WA63272: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL64109%27 HTTP/1.1" 200 None
2026-03-30 12:46:08 [auto1.fr] INFO: Scrape type for FL64109: 0
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 12:46:08 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 12:46:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:46:29 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 5845 | hits on page: 40
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT63843%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for NT63843: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK91358%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for HK91358: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM04459%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for UM04459: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ20890%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for XJ20890: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK32012%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for FK32012: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM62248%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for JM62248: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE62259%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for AE62259: 0
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 12:46:29 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH09576%27 HTTP/1.1" 200 None
2026-03-30 12:46:29 [auto1.fr] INFO: Scrape type for YH09576: 0
2026-03-30 12:46:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:46:48 [scrapy.extensions.logstats] INFO: Crawled 334 pages (at 3 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 12:46:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:47:15 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 5852 | hits on page: 40
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM62248%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for JM62248: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE62259%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for AE62259: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH09576%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for YH09576: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT98843%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for KT98843: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG55278%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for XG55278: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW28682%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for AW28682: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD34390%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for WD34390: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT56406%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for VT56406: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH27113%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for NH27113: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY59235%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for CY59235: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC69819%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for DC69819: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY73034%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for MY73034: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS06756%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for DS06756: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF25256%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for PF25256: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD52319%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for MD52319: 0
2026-03-30 12:47:15 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH20400%27 HTTP/1.1" 200 None
2026-03-30 12:47:15 [auto1.fr] INFO: Scrape type for PH20400: 0
2026-03-30 12:47:16 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 12:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG76800%27 HTTP/1.1" 200 None
2026-03-30 12:47:16 [auto1.fr] INFO: Scrape type for JG76800: 0
2026-03-30 12:47:16 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 12:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:47:32 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 5855 | hits on page: 40
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH20400%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for PH20400: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG76800%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for JG76800: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA46482%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for XA46482: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB90330%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for PB90330: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG53401%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for NG53401: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG36017%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for RG36017: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA43171%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for WA43171: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL49541%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for KL49541: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX65717%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for UX65717: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH48346%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for KH48346: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM49581%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for GM49581: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF47912%27 HTTP/1.1" 200 None
2026-03-30 12:47:32 [auto1.fr] INFO: Scrape type for AF47912: 0
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 12:47:32 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 12:47:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:47:45 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 5855 | hits on page: 40
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG31617%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for RG31617: 0
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX32872%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for HX32872: 0
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH62063%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for RH62063: 0
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED69892%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for ED69892: 0
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ17018%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for BZ17018: 0
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 12:47:45 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV49622%27 HTTP/1.1" 200 None
2026-03-30 12:47:45 [auto1.fr] INFO: Scrape type for WV49622: 2
2026-03-30 12:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-03-30 12:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68df8024-444a-5cf7-90a9-80618ce62204 with scrape type 2
2026-03-30 12:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68df8024-444a-5cf7-90a9-80618ce62204 with scrape type 2
2026-03-30 12:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68df8024-444a-5cf7-90a9-80618ce62204, identifier: WV49622
2026-03-30 12:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-03-30 12:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-03-30 12:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622 to the API
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': '68df8024-444a-5cf7-90a9-80618ce62204',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV49622',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 113152,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-27',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV49622%27 HTTP/1.1" 200 None
2026-03-30 12:47:46 [auto1.fr] INFO: Saving data for WV49622: {'auction_closing_time': 1774884508.0, 'created_time': 1773919819.680649, 'last_price_update_time': 1774874866.327785}
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV49622') HTTP/1.1" 204 0
2026-03-30 12:47:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN72377%27 HTTP/1.1" 200 None
2026-03-30 12:47:46 [auto1.fr] INFO: Scrape type for FN72377: 0
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ60923%27 HTTP/1.1" 200 None
2026-03-30 12:47:46 [auto1.fr] INFO: Scrape type for TZ60923: 0
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 12:47:46 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 12:47:48 [scrapy.extensions.logstats] INFO: Crawled 337 pages (at 3 pages/min), scraped 223 items (at 1 items/min)
2026-03-30 12:47:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:48:48 [scrapy.extensions.logstats] INFO: Crawled 337 pages (at 0 pages/min), scraped 223 items (at 0 items/min)
2026-03-30 12:48:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:48:56 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 5861 | hits on page: 40
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP43098%27 HTTP/1.1" 200 None
2026-03-30 12:48:56 [auto1.fr] INFO: Scrape type for PP43098: 0
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU33425%27 HTTP/1.1" 200 None
2026-03-30 12:48:56 [auto1.fr] INFO: Scrape type for ZU33425: 0
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ63640%27 HTTP/1.1" 200 None
2026-03-30 12:48:56 [auto1.fr] INFO: Scrape type for XJ63640: 0
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB49566%27 HTTP/1.1" 200 None
2026-03-30 12:48:56 [auto1.fr] INFO: Scrape type for CB49566: 0
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE03230%27 HTTP/1.1" 200 None
2026-03-30 12:48:56 [auto1.fr] INFO: Scrape type for RE03230: 0
2026-03-30 12:48:56 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 12:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:48 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 1 pages/min), scraped 223 items (at 0 items/min)
2026-03-30 12:49:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:50:48 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 0 pages/min), scraped 223 items (at 0 items/min)
2026-03-30 12:50:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:51:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.654(s), this was the 1st time calling it.
2026-03-30 12:51:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.605650097197502 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:51:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:51:48 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 0 pages/min), scraped 223 items (at 0 items/min)
2026-03-30 12:51:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:51:49 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 5881 | hits on page: 40
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU33425%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for ZU33425: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ63640%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for XJ63640: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB49566%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for CB49566: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE03230%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for RE03230: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ98730%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for CZ98730: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV73916%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for CV73916: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY63463%27 HTTP/1.1" 200 None
2026-03-30 12:51:49 [auto1.fr] INFO: Scrape type for CY63463: 0
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 12:51:49 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 12:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL61056%27 HTTP/1.1" 200 None
2026-03-30 12:51:50 [auto1.fr] INFO: Scrape type for DL61056: 0
2026-03-30 12:51:50 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 12:51:50 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 12:51:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:51:52 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 5882 | hits on page: 40
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX50814%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for MX50814: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP62377%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for TP62377: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN48147%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for PN48147: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH41597%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for KH41597: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN45493%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for EN45493: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE49772%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for AE49772: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT77468%27 HTTP/1.1" 200 None
2026-03-30 12:51:52 [auto1.fr] INFO: Scrape type for JT77468: 0
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 12:51:52 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 12:51:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:04 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 5884 | hits on page: 40
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX44098%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for HX44098: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS33880%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for RS33880: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU39722%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for RU39722: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL73854%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for DL73854: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW62660%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for UW62660: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS65333%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for HS65333: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG41300%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for HG41300: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC48696%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for MC48696: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB39116%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for EB39116: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS65527%27 HTTP/1.1" 200 None
2026-03-30 12:52:04 [auto1.fr] INFO: Scrape type for WS65527: 0
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 12:52:04 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 12:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:05 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 5884 | hits on page: 40
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK69848%27 HTTP/1.1" 200 None
2026-03-30 12:52:05 [auto1.fr] INFO: Scrape type for TK69848: 0
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ05555%27 HTTP/1.1" 200 None
2026-03-30 12:52:05 [auto1.fr] INFO: Scrape type for YJ05555: 0
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX48678%27 HTTP/1.1" 200 None
2026-03-30 12:52:05 [auto1.fr] INFO: Scrape type for SX48678: 0
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM94372%27 HTTP/1.1" 200 None
2026-03-30 12:52:05 [auto1.fr] INFO: Scrape type for RM94372: 0
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 12:52:05 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP79464%27 HTTP/1.1" 200 None
2026-03-30 12:52:06 [auto1.fr] INFO: Scrape type for SP79464: 0
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY88225%27 HTTP/1.1" 200 None
2026-03-30 12:52:06 [auto1.fr] INFO: Scrape type for RY88225: 0
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE89694%27 HTTP/1.1" 200 None
2026-03-30 12:52:06 [auto1.fr] INFO: Scrape type for NE89694: 0
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 12:52:06 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 12:52:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:08 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC04532%27 HTTP/1.1" 200 None
2026-03-30 12:52:08 [auto1.fr] INFO: Scrape type for JC04532: 0
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP83519%27 HTTP/1.1" 200 None
2026-03-30 12:52:08 [auto1.fr] INFO: Scrape type for HP83519: 0
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 12:52:08 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV68573%27 HTTP/1.1" 200 None
2026-03-30 12:52:08 [auto1.fr] INFO: Scrape type for UV68573: 2
2026-03-30 12:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with identifier: UV68573
2026-03-30 12:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with scrape type 2
2026-03-30 12:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with scrape type 2
2026-03-30 12:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 92e988de-5885-5ed8-8bb4-bb18ebc6bb45, identifier: UV68573
2026-03-30 12:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with identifier: UV68573
2026-03-30 12:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with identifier: UV68573
2026-03-30 12:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 92e988de-5885-5ed8-8bb4-bb18ebc6bb45 with identifier: UV68573 to the API
2026-03-30 12:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:27Z',
'fuel_type': 'petrol',
'id': '92e988de-5885-5ed8-8bb4-bb18ebc6bb45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV68573',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 36539,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-26',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV68573%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Saving data for UV68573: {'auction_closing_time': 1774886307.0, 'created_time': 1774015655.589334, 'last_price_update_time': 1774875129.143862}
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UV68573') HTTP/1.1" 204 0
2026-03-30 12:52:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN94578%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for CN94578: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK86276%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for NK86276: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV26699%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for MV26699: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW91019%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for KW91019: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE52492%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for DE52492: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS39466%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for KS39466: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK27379%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for GK27379: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ72790%27 HTTP/1.1" 200 None
2026-03-30 12:52:09 [auto1.fr] INFO: Scrape type for BZ72790: 0
2026-03-30 12:52:09 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 12:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:10 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG47762%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for SG47762: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY53378%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for JY53378: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ64776%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for WJ64776: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ77975%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for VJ77975: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU89344%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for TU89344: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF64188%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for SF64188: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN07999%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for PN07999: 0
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 12:52:10 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX45079%27 HTTP/1.1" 200 None
2026-03-30 12:52:10 [auto1.fr] INFO: Scrape type for WX45079: 0
2026-03-30 12:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:48 [scrapy.extensions.logstats] INFO: Crawled 344 pages (at 6 pages/min), scraped 224 items (at 1 items/min)
2026-03-30 12:52:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:53:48 [scrapy.extensions.logstats] INFO: Crawled 344 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 12:53:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:54:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.888(s), this was the 1st time calling it.
2026-03-30 12:54:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.368192066466643 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:54:27 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 5894 | hits on page: 40
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF64188%27 HTTP/1.1" 200 None
2026-03-30 12:54:27 [auto1.fr] INFO: Scrape type for SF64188: 0
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN07999%27 HTTP/1.1" 200 None
2026-03-30 12:54:27 [auto1.fr] INFO: Scrape type for PN07999: 0
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX45079%27 HTTP/1.1" 200 None
2026-03-30 12:54:27 [auto1.fr] INFO: Scrape type for WX45079: 0
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG73780%27 HTTP/1.1" 200 None
2026-03-30 12:54:27 [auto1.fr] INFO: Scrape type for GG73780: 0
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 12:54:27 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB73414%27 HTTP/1.1" 200 None
2026-03-30 12:54:27 [auto1.fr] INFO: Scrape type for FB73414: 2
2026-03-30 12:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with identifier: FB73414
2026-03-30 12:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with scrape type 2
2026-03-30 12:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with scrape type 2
2026-03-30 12:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8961a0f5-d309-51c6-8ccd-ba8c52812d8d, identifier: FB73414
2026-03-30 12:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with identifier: FB73414
2026-03-30 12:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with identifier: FB73414
2026-03-30 12:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8961a0f5-d309-51c6-8ccd-ba8c52812d8d with identifier: FB73414 to the API
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:02:51Z',
'fuel_type': 'diesel',
'id': '8961a0f5-d309-51c6-8ccd-ba8c52812d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB73414',
'listing': 'auction',
'make': 'MINI',
'model': 'Paceman',
'odometer': 148646,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-18',
'seller_name': None,
'title': 'MINI Paceman Cooper SD ALL4',
'transmission': 'manual',
'trim': 'ALL4',
'year': 2014}
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB73414%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Saving data for FB73414: {'auction_closing_time': 1774882971.0, 'created_time': 1774599357.317616, 'last_price_update_time': 1774875268.437201}
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB73414') HTTP/1.1" 204 0
2026-03-30 12:54:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH57355%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for XH57355: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU24116%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for ZU24116: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU32424%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for MU32424: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP72433%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for NP72433: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV28577%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for VV28577: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF02632%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for NF02632: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV09040%27 HTTP/1.1" 200 None
2026-03-30 12:54:28 [auto1.fr] INFO: Scrape type for AV09040: 0
2026-03-30 12:54:28 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 12:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:54:33 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 5894 | hits on page: 40
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL68032%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for PL68032: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB82308%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for WB82308: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE54565%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for UE54565: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH95657%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for YH95657: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD33485%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for LD33485: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV70333%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for YV70333: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA45879%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for MA45879: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM37248%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for VM37248: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS73849%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for AS73849: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG53026%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for KG53026: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT21688%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for AT21688: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA55744%27 HTTP/1.1" 200 None
2026-03-30 12:54:33 [auto1.fr] INFO: Scrape type for TA55744: 0
2026-03-30 12:54:33 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 12:54:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:54:48 [scrapy.extensions.logstats] INFO: Crawled 346 pages (at 2 pages/min), scraped 225 items (at 1 items/min)
2026-03-30 12:54:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:54:54 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 5896 | hits on page: 40
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA55744%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for TA55744: 0
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE73084%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for BE73084: 0
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ94034%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for LZ94034: 0
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK18532%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for KK18532: 0
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ87418%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for AZ87418: 0
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 12:54:54 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF53419%27 HTTP/1.1" 200 None
2026-03-30 12:54:54 [auto1.fr] INFO: Scrape type for MF53419: 2
2026-03-30 12:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabafddc-f399-560d-a113-ebee25b8eba4 with identifier: MF53419
2026-03-30 12:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabafddc-f399-560d-a113-ebee25b8eba4 with scrape type 2
2026-03-30 12:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabafddc-f399-560d-a113-ebee25b8eba4 with scrape type 2
2026-03-30 12:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eabafddc-f399-560d-a113-ebee25b8eba4, identifier: MF53419
2026-03-30 12:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eabafddc-f399-560d-a113-ebee25b8eba4 with identifier: MF53419
2026-03-30 12:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eabafddc-f399-560d-a113-ebee25b8eba4 with identifier: MF53419
2026-03-30 12:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eabafddc-f399-560d-a113-ebee25b8eba4 with identifier: MF53419 to the API
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:04:44Z',
'fuel_type': 'petrol',
'id': 'eabafddc-f399-560d-a113-ebee25b8eba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF53419',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 192654,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-31',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250 AMG Sport',
'transmission': 'automatic',
'trim': 'AMG Sport',
'year': 2013}
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF53419%27 HTTP/1.1" 200 None
2026-03-30 12:54:55 [auto1.fr] INFO: Saving data for MF53419: {'auction_closing_time': 1774883084.0, 'created_time': 1774599356.965497, 'last_price_update_time': 1774875295.559673}
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF53419') HTTP/1.1" 204 0
2026-03-30 12:54:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK96121%27 HTTP/1.1" 200 None
2026-03-30 12:54:55 [auto1.fr] INFO: Scrape type for KK96121: 0
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV28672%27 HTTP/1.1" 200 None
2026-03-30 12:54:55 [auto1.fr] INFO: Scrape type for BV28672: 0
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 12:54:55 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 12:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:55:28 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 5898 | hits on page: 40
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL24585%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for YL24585: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK24652%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for SK24652: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS26317%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for FS26317: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK71446%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for XK71446: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK04958%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for VK04958: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF97321%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for TF97321: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY57197%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for CY57197: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG03351%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for YG03351: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC71697%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for NC71697: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX75346%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for HX75346: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS75387%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for HS75387: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB88152%27 HTTP/1.1" 200 None
2026-03-30 12:55:28 [auto1.fr] INFO: Scrape type for PB88152: 0
2026-03-30 12:55:28 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 12:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:55:37 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 5898 | hits on page: 40
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV30155%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for SV30155: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE20699%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for NE20699: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX53483%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for AX53483: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH41979%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for HH41979: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST56941%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for ST56941: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA84507%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for LA84507: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB93167%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for EB93167: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ54898%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for JJ54898: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB07315%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for HB07315: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY62204%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for NY62204: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ01379%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for WJ01379: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ49621%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for PJ49621: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE06169%27 HTTP/1.1" 200 None
2026-03-30 12:55:37 [auto1.fr] INFO: Scrape type for ZE06169: 0
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 12:55:37 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 12:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:55:48 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 3 pages/min), scraped 226 items (at 1 items/min)
2026-03-30 12:55:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:56:43 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 5902 | hits on page: 40
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE06169%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for ZE06169: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK35236%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for SK35236: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF21146%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for WF21146: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV78191%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for TV78191: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV59700%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for HV59700: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS50564%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for VS50564: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL73975%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for UL73975: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS24945%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for LS24945: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB78829%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for RB78829: 0
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR83057%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Scrape type for LR83057: 2
2026-03-30 12:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d83d8c-00a2-5c22-bf1a-67573e854a69 with identifier: LR83057
2026-03-30 12:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d83d8c-00a2-5c22-bf1a-67573e854a69 with scrape type 2
2026-03-30 12:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d83d8c-00a2-5c22-bf1a-67573e854a69 with scrape type 2
2026-03-30 12:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13d83d8c-00a2-5c22-bf1a-67573e854a69, identifier: LR83057
2026-03-30 12:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13d83d8c-00a2-5c22-bf1a-67573e854a69 with identifier: LR83057
2026-03-30 12:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13d83d8c-00a2-5c22-bf1a-67573e854a69 with identifier: LR83057
2026-03-30 12:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13d83d8c-00a2-5c22-bf1a-67573e854a69 with identifier: LR83057 to the API
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:39:06Z',
'fuel_type': 'petrol',
'id': '13d83d8c-00a2-5c22-bf1a-67573e854a69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR83057',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 128424,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-26',
'seller_name': None,
'title': 'Opel Corsa 1.2 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2008}
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR83057%27 HTTP/1.1" 200 None
2026-03-30 12:56:43 [auto1.fr] INFO: Saving data for LR83057: {'auction_closing_time': 1774885146.0, 'created_time': 1774599324.146186, 'last_price_update_time': 1774875403.887039}
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LR83057') HTTP/1.1" 204 0
2026-03-30 12:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 12:56:43 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN28045%27 HTTP/1.1" 200 None
2026-03-30 12:56:44 [auto1.fr] INFO: Scrape type for EN28045: 0
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE26786%27 HTTP/1.1" 200 None
2026-03-30 12:56:44 [auto1.fr] INFO: Scrape type for EE26786: 0
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL75425%27 HTTP/1.1" 200 None
2026-03-30 12:56:44 [auto1.fr] INFO: Scrape type for UL75425: 0
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 12:56:44 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 12:56:48 [scrapy.extensions.logstats] INFO: Crawled 350 pages (at 1 pages/min), scraped 227 items (at 1 items/min)
2026-03-30 12:56:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:56:50 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 5905 | hits on page: 40
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL75425%27 HTTP/1.1" 200 None
2026-03-30 12:56:50 [auto1.fr] INFO: Scrape type for UL75425: 0
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 12:56:50 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP22528%27 HTTP/1.1" 200 None
2026-03-30 12:56:50 [auto1.fr] INFO: Scrape type for HP22528: 2
2026-03-30 12:56:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6d0af74-32d1-5f5c-b066-16711f8f7986 with identifier: HP22528
2026-03-30 12:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6d0af74-32d1-5f5c-b066-16711f8f7986 with scrape type 2
2026-03-30 12:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6d0af74-32d1-5f5c-b066-16711f8f7986 with scrape type 2
2026-03-30 12:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a6d0af74-32d1-5f5c-b066-16711f8f7986, identifier: HP22528
2026-03-30 12:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a6d0af74-32d1-5f5c-b066-16711f8f7986 with identifier: HP22528
2026-03-30 12:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a6d0af74-32d1-5f5c-b066-16711f8f7986 with identifier: HP22528
2026-03-30 12:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a6d0af74-32d1-5f5c-b066-16711f8f7986 with identifier: HP22528 to the API
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:09Z',
'fuel_type': 'diesel',
'id': 'a6d0af74-32d1-5f5c-b066-16711f8f7986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP22528',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 115251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP22528%27 HTTP/1.1" 200 None
2026-03-30 12:56:50 [auto1.fr] INFO: Saving data for HP22528: {'auction_closing_time': 1774884369.0, 'created_time': 1773334296.83435, 'last_price_update_time': 1774875410.911482}
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HP22528') HTTP/1.1" 204 0
2026-03-30 12:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY12780%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for EY12780: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC93454%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for VC93454: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX87630%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for LX87630: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS88817%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for YS88817: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM62215%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for KM62215: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN64616%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for VN64616: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP19008%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for UP19008: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM27790%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for GM27790: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ56198%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for NJ56198: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD36539%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for MD36539: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY07389%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for JY07389: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF46973%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for EF46973: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH91643%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for KH91643: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP75778%27 HTTP/1.1" 200 None
2026-03-30 12:56:51 [auto1.fr] INFO: Scrape type for EP75778: 0
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 12:56:51 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 12:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:56:58 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 5905 | hits on page: 40
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 12:56:58 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW47860%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for SW47860: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ17608%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for BJ17608: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS93501%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for VS93501: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK05830%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for FK05830: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ88621%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for NZ88621: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC34167%27 HTTP/1.1" 200 None
2026-03-30 12:56:59 [auto1.fr] INFO: Scrape type for DC34167: 0
2026-03-30 12:56:59 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 12:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:57:06 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 5905 | hits on page: 40
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY25018%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for VY25018: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK76842%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for WK76842: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH57081%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for NH57081: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD98684%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for XD98684: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR77796%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for UR77796: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA65542%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for AA65542: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP41770%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for TP41770: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF32132%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for CF32132: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK11725%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for UK11725: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM86086%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for JM86086: 0
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 12:57:06 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE93156%27 HTTP/1.1" 200 None
2026-03-30 12:57:06 [auto1.fr] INFO: Scrape type for GE93156: 0
2026-03-30 12:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:57:11 [auto1.fr] INFO: Channel: 24h | Page: 102 | totalHits: 5906 | hits on page: 40
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE93156%27 HTTP/1.1" 200 None
2026-03-30 12:57:11 [auto1.fr] INFO: Scrape type for GE93156: 0
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV87304%27 HTTP/1.1" 200 None
2026-03-30 12:57:11 [auto1.fr] INFO: Scrape type for GV87304: 0
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH15197%27 HTTP/1.1" 200 None
2026-03-30 12:57:11 [auto1.fr] INFO: Scrape type for GH15197: 0
2026-03-30 12:57:11 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR25442%27 HTTP/1.1" 200 None
2026-03-30 12:57:11 [auto1.fr] INFO: Scrape type for TR25442: 2
2026-03-30 12:57:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with identifier: TR25442
2026-03-30 12:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with scrape type 2
2026-03-30 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with scrape type 2
2026-03-30 12:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43256e1f-edc1-5a4f-a68b-ad6da5ee249e, identifier: TR25442
2026-03-30 12:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with identifier: TR25442
2026-03-30 12:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with identifier: TR25442
2026-03-30 12:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43256e1f-edc1-5a4f-a68b-ad6da5ee249e with identifier: TR25442 to the API
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:09:23Z',
'fuel_type': 'petrol',
'id': '43256e1f-edc1-5a4f-a68b-ad6da5ee249e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR25442',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 136061,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2018}
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR25442%27 HTTP/1.1" 200 None
2026-03-30 12:57:11 [auto1.fr] INFO: Saving data for TR25442: {'auction_closing_time': 1774883363.0, 'created_time': 1774599322.36445, 'last_price_update_time': 1774875431.876543}
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR25442') HTTP/1.1" 204 0
2026-03-30 12:57:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS23568%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for HS23568: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ16726%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for MZ16726: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW84739%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for UW84739: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE35330%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for PE35330: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA14962%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for JA14962: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT58099%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for ZT58099: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM83805%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for UM83805: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP65442%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for KP65442: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK17359%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for MK17359: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG25473%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for VG25473: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX93622%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for HX93622: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK83692%27 HTTP/1.1" 200 None
2026-03-30 12:57:12 [auto1.fr] INFO: Scrape type for KK83692: 0
2026-03-30 12:57:12 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 12:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:57:16 [auto1.fr] INFO: Channel: 24h | Page: 103 | totalHits: 5906 | hits on page: 40
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF87299%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for XF87299: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN39968%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for LN39968: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV64742%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for EV64742: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX73397%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for UX73397: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE44900%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for HE44900: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND09422%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for ND09422: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK52044%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for JK52044: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW51831%27 HTTP/1.1" 200 None
2026-03-30 12:57:16 [auto1.fr] INFO: Scrape type for YW51831: 0
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 12:57:16 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 12:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:57:48 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 5 pages/min), scraped 229 items (at 2 items/min)
2026-03-30 12:57:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:58:48 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 12:58:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 12:59:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.705(s), this was the 1st time calling it.
2026-03-30 12:59:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.431154531754915 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:59:48 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 12:59:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:00:48 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:00:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:01:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.921(s), this was the 2nd time calling it.
2026-03-30 13:01:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.89804976728718 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:01:48 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:01:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 13:01:53 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:01:53 [auto1.fr] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3652.0s). Queued for retry (1 pending).
2026-03-30 13:01:53 [auto1.fr] INFO: Initiating token refresh...
2026-03-30 13:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:01:57 [auto1.fr] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 13:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:02:02 [auto1.fr] INFO: Channel: 24h | Page: 104 | totalHits: 5933 | hits on page: 40
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV64742%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for EV64742: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX73397%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for UX73397: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE44900%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for HE44900: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND09422%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for ND09422: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK52044%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for JK52044: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW51831%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for YW51831: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER13695%27 HTTP/1.1" 200 None
2026-03-30 13:02:02 [auto1.fr] INFO: Scrape type for ER13695: 0
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 13:02:02 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 13:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:02:10 [auto1.fr] INFO: Channel: 24h | Page: 105 | totalHits: 5934 | hits on page: 40
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD39200%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for RD39200: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM88611%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for BM88611: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF38659%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for VF38659: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL85301%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for KL85301: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY35486%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for HY35486: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN13848%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for AN13848: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ02897%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for YZ02897: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA82205%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for BA82205: 0
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 13:02:10 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP25340%27 HTTP/1.1" 200 None
2026-03-30 13:02:10 [auto1.fr] INFO: Scrape type for VP25340: 0
2026-03-30 13:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:02:11 [auto1.fr] INFO: Channel: 24h | Page: 106 | totalHits: 5934 | hits on page: 40
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF11436%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for KF11436: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU40545%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for SU40545: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR71429%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for CR71429: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP09447%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for HP09447: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC90261%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for CC90261: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP46372%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for LP46372: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC17210%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for EC17210: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ91890%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for EJ91890: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT16530%27 HTTP/1.1" 200 None
2026-03-30 13:02:11 [auto1.fr] INFO: Scrape type for GT16530: 0
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 13:02:11 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 13:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:02:16 [auto1.fr] INFO: Channel: 24h | Page: 107 | totalHits: 5934 | hits on page: 40
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK12827%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for AK12827: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT99319%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for RT99319: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR00420%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for BR00420: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW63127%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for SW63127: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH45766%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for TH45766: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD29235%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for DD29235: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN97834%27 HTTP/1.1" 200 None
2026-03-30 13:02:16 [auto1.fr] INFO: Scrape type for DN97834: 0
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 13:02:16 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 13:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:02:48 [scrapy.extensions.logstats] INFO: Crawled 361 pages (at 6 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:02:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:03:48 [scrapy.extensions.logstats] INFO: Crawled 361 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:03:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:04:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.460(s), this was the 1st time calling it.
2026-03-30 13:04:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.910156419641647 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:04:33 [auto1.fr] INFO: Channel: 24h | Page: 108 | totalHits: 5945 | hits on page: 40
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN97834%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for DN97834: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR61190%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for AR61190: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB20232%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for SB20232: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ70435%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for FJ70435: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ17908%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for MZ17908: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY09161%27 HTTP/1.1" 200 None
2026-03-30 13:04:33 [auto1.fr] INFO: Scrape type for MY09161: 0
2026-03-30 13:04:33 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 13:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF94753%27 HTTP/1.1" 200 None
2026-03-30 13:04:34 [auto1.fr] INFO: Scrape type for TF94753: 0
2026-03-30 13:04:34 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 13:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC91705%27 HTTP/1.1" 200 None
2026-03-30 13:04:34 [auto1.fr] INFO: Scrape type for AC91705: 0
2026-03-30 13:04:34 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 13:04:34 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 13:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX16987%27 HTTP/1.1" 200 None
2026-03-30 13:04:34 [auto1.fr] INFO: Scrape type for UX16987: 0
2026-03-30 13:04:34 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 13:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:04:35 [auto1.fr] INFO: Channel: 24h | Page: 109 | totalHits: 5945 | hits on page: 40
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL75715%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for KL75715: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE12158%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for XE12158: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV56831%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for UV56831: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF49940%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for RF49940: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK87093%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for LK87093: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB49673%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for RB49673: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF91897%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for NF91897: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX19943%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for JX19943: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF38661%27 HTTP/1.1" 200 None
2026-03-30 13:04:35 [auto1.fr] INFO: Scrape type for EF38661: 0
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 13:04:35 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 13:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:04:48 [scrapy.extensions.logstats] INFO: Crawled 363 pages (at 2 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:04:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:05:48 [scrapy.extensions.logstats] INFO: Crawled 363 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:05:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:06:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.217(s), this was the 1st time calling it.
2026-03-30 13:06:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.325708106644381 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:06:48 [scrapy.extensions.logstats] INFO: Crawled 363 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-03-30 13:06:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:06:59 [auto1.fr] INFO: Channel: 24h | Page: 110 | totalHits: 5956 | hits on page: 40
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX19943%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for JX19943: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF38661%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for EF38661: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC31783%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for EC31783: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP85730%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for MP85730: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ16711%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for YZ16711: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC74849%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for FC74849: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ58184%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for AZ58184: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM86019%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for VM86019: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM01118%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for UM01118: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 13:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:03 [auto1.fr] INFO: Channel: 24h | Page: 111 | totalHits: 5956 | hits on page: 40
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU45955%27 HTTP/1.1" 200 None
2026-03-30 13:07:03 [auto1.fr] INFO: Scrape type for RU45955: 0
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL54463%27 HTTP/1.1" 200 None
2026-03-30 13:07:03 [auto1.fr] INFO: Scrape type for CL54463: 0
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF77875%27 HTTP/1.1" 200 None
2026-03-30 13:07:03 [auto1.fr] INFO: Scrape type for MF77875: 0
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS07169%27 HTTP/1.1" 200 None
2026-03-30 13:07:03 [auto1.fr] INFO: Scrape type for GS07169: 0
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM62874%27 HTTP/1.1" 200 None
2026-03-30 13:07:03 [auto1.fr] INFO: Scrape type for UM62874: 0
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 13:07:03 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH59874%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for FH59874: 0
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG24288%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for TG24288: 0
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK98853%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for DK98853: 0
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG30830%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for HG30830: 0
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB86002%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for CB86002: 0
2026-03-30 13:07:04 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG61508%27 HTTP/1.1" 200 None
2026-03-30 13:07:04 [auto1.fr] INFO: Scrape type for WG61508: 0
2026-03-30 13:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:13 [auto1.fr] INFO: Channel: 24h | Page: 112 | totalHits: 5956 | hits on page: 40
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE63144%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for AE63144: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC18078%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for UC18078: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ47364%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for RZ47364: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD18216%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for TD18216: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA20001%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for MA20001: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA02670%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for JA02670: 2
2026-03-30 13:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with identifier: JA02670
2026-03-30 13:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with scrape type 2
2026-03-30 13:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with scrape type 2
2026-03-30 13:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27, identifier: JA02670
2026-03-30 13:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with identifier: JA02670
2026-03-30 13:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with identifier: JA02670
2026-03-30 13:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4773d0d9-53f0-5e0a-ac57-fb3b7f171f27 with identifier: JA02670 to the API
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:17:12Z',
'fuel_type': 'petrol',
'id': '4773d0d9-53f0-5e0a-ac57-fb3b7f171f27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA02670',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 45801,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-12',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2019}
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA02670%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Saving data for JA02670: {'auction_closing_time': 1774883832.0, 'created_time': 1774038780.64687, 'last_price_update_time': 1774876033.587287}
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA02670') HTTP/1.1" 204 0
2026-03-30 13:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV29196%27 HTTP/1.1" 200 None
2026-03-30 13:07:13 [auto1.fr] INFO: Scrape type for RV29196: 0
2026-03-30 13:07:13 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 13:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:26 [auto1.fr] INFO: Channel: 24h | Page: 113 | totalHits: 5957 | hits on page: 40
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL96351%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for PL96351: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE72245%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for PE72245: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX05016%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for XX05016: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG76188%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for PG76188: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN72204%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for GN72204: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX44773%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for NX44773: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX50304%27 HTTP/1.1" 200 None
2026-03-30 13:07:26 [auto1.fr] INFO: Scrape type for SX50304: 0
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 13:07:26 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 13:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:28 [auto1.fr] INFO: Channel: 24h | Page: 114 | totalHits: 5957 | hits on page: 40
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX89558%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for ZX89558: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY01215%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for MY01215: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ31250%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for BZ31250: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR43233%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for RR43233: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK08902%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for EK08902: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ51504%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for MZ51504: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND52454%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for ND52454: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX34772%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for EX34772: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC98272%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for TC98272: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE53332%27 HTTP/1.1" 200 None
2026-03-30 13:07:28 [auto1.fr] INFO: Scrape type for AE53332: 0
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 13:07:28 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 13:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:48 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 5 pages/min), scraped 230 items (at 1 items/min)
2026-03-30 13:07:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:08:48 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 0 pages/min), scraped 230 items (at 0 items/min)
2026-03-30 13:08:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:09:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.685(s), this was the 1st time calling it.
2026-03-30 13:09:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.90345775023604 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:09:43 [auto1.fr] INFO: Channel: 24h | Page: 115 | totalHits: 5965 | hits on page: 40
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE53332%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for AE53332: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC92409%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for XC92409: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU86663%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for PU86663: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF03243%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for VF03243: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ88251%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for GZ88251: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS55065%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for TS55065: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM05326%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for DM05326: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR10994%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for WR10994: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM93614%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for AM93614: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD23905%27 HTTP/1.1" 200 None
2026-03-30 13:09:43 [auto1.fr] INFO: Scrape type for DD23905: 0
2026-03-30 13:09:43 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 13:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:09:45 [auto1.fr] INFO: Channel: 24h | Page: 116 | totalHits: 5965 | hits on page: 40
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT84639%27 HTTP/1.1" 200 None
2026-03-30 13:09:45 [auto1.fr] INFO: Scrape type for XT84639: 0
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03257%27 HTTP/1.1" 200 None
2026-03-30 13:09:45 [auto1.fr] INFO: Scrape type for VV03257: 0
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE03503%27 HTTP/1.1" 200 None
2026-03-30 13:09:45 [auto1.fr] INFO: Scrape type for YE03503: 0
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB68741%27 HTTP/1.1" 200 None
2026-03-30 13:09:45 [auto1.fr] INFO: Scrape type for KB68741: 0
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW37033%27 HTTP/1.1" 200 None
2026-03-30 13:09:45 [auto1.fr] INFO: Scrape type for KW37033: 0
2026-03-30 13:09:45 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 13:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:09:48 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 2 pages/min), scraped 230 items (at 0 items/min)
2026-03-30 13:09:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:09:50 [auto1.fr] INFO: Channel: 24h | Page: 117 | totalHits: 5965 | hits on page: 40
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA65311%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for PA65311: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM91019%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for SM91019: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF21819%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for UF21819: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH25784%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for JH25784: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ29292%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for MJ29292: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW41550%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for NW41550: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE69651%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for NE69651: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS13354%27 HTTP/1.1" 200 None
2026-03-30 13:09:50 [auto1.fr] INFO: Scrape type for BS13354: 0
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 13:09:50 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 13:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:09:54 [auto1.fr] INFO: Channel: 24h | Page: 118 | totalHits: 5967 | hits on page: 40
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU93823%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for AU93823: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX37071%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for BX37071: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA87670%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for RA87670: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD49432%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for FD49432: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM83925%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for MM83925: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH84744%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for HH84744: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL40809%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for NL40809: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP37430%27 HTTP/1.1" 200 None
2026-03-30 13:09:54 [auto1.fr] INFO: Scrape type for MP37430: 0
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 13:09:54 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 13:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG34016%27 HTTP/1.1" 200 None
2026-03-30 13:09:55 [auto1.fr] INFO: Scrape type for YG34016: 0
2026-03-30 13:09:55 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 13:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE79860%27 HTTP/1.1" 200 None
2026-03-30 13:09:55 [auto1.fr] INFO: Scrape type for TE79860: 0
2026-03-30 13:09:55 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 13:09:55 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 13:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE10881%27 HTTP/1.1" 200 None
2026-03-30 13:09:55 [auto1.fr] INFO: Scrape type for WE10881: 0
2026-03-30 13:09:55 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 13:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:10:48 [scrapy.extensions.logstats] INFO: Crawled 372 pages (at 2 pages/min), scraped 230 items (at 0 items/min)
2026-03-30 13:10:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:11:48 [scrapy.extensions.logstats] INFO: Crawled 372 pages (at 0 pages/min), scraped 230 items (at 0 items/min)
2026-03-30 13:11:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:12:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.316(s), this was the 1st time calling it.
2026-03-30 13:12:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.674348841198231 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:12:15 [auto1.fr] INFO: Channel: 24h | Page: 119 | totalHits: 5980 | hits on page: 40
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL40809%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for NL40809: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP37430%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for MP37430: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG34016%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for YG34016: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE79860%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for TE79860: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE10881%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for WE10881: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD10850%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for GD10850: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW65411%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for TW65411: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK73571%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for KK73571: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL32423%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for LL32423: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR46637%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for UR46637: 0
2026-03-30 13:12:15 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF53447%27 HTTP/1.1" 200 None
2026-03-30 13:12:15 [auto1.fr] INFO: Scrape type for NF53447: 2
2026-03-30 13:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with identifier: NF53447
2026-03-30 13:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with scrape type 2
2026-03-30 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with scrape type 2
2026-03-30 13:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3b784a30-c631-55cf-8068-8b0e0e3b8f4d, identifier: NF53447
2026-03-30 13:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with identifier: NF53447
2026-03-30 13:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with identifier: NF53447
2026-03-30 13:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3b784a30-c631-55cf-8068-8b0e0e3b8f4d with identifier: NF53447 to the API
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:48:40Z',
'fuel_type': 'petrol',
'id': '3b784a30-c631-55cf-8068-8b0e0e3b8f4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF53447',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 122997,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-13',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2017}
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF53447%27 HTTP/1.1" 200 None
2026-03-30 13:12:16 [auto1.fr] INFO: Saving data for NF53447: {'auction_closing_time': 1774885720.0, 'created_time': 1774599321.590895, 'last_price_update_time': 1774876336.067443}
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF53447') HTTP/1.1" 204 0
2026-03-30 13:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ30522%27 HTTP/1.1" 200 None
2026-03-30 13:12:16 [auto1.fr] INFO: Scrape type for VJ30522: 0
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ04578%27 HTTP/1.1" 200 None
2026-03-30 13:12:16 [auto1.fr] INFO: Scrape type for XJ04578: 0
2026-03-30 13:12:16 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:12:20 [auto1.fr] INFO: Channel: 24h | Page: 120 | totalHits: 5980 | hits on page: 40
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ11575%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for LZ11575: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY02947%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for EY02947: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD42608%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for VD42608: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV47418%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for CV47418: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ22712%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for GJ22712: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ79043%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for MJ79043: 0
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 13:12:20 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY91860%27 HTTP/1.1" 200 None
2026-03-30 13:12:20 [auto1.fr] INFO: Scrape type for AY91860: 0
2026-03-30 13:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:12:48 [scrapy.extensions.logstats] INFO: Crawled 374 pages (at 2 pages/min), scraped 231 items (at 1 items/min)
2026-03-30 13:12:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:12:54 [auto1.fr] INFO: Channel: 24h | Page: 121 | totalHits: 5981 | hits on page: 40
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY91860%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for AY91860: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC58992%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for HC58992: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS17266%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for GS17266: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM45421%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for UM45421: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT81791%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for AT81791: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH76709%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for LH76709: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC05941%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for RC05941: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP34211%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for BP34211: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU30754%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for CU30754: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ88800%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for PZ88800: 0
2026-03-30 13:12:54 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD76165%27 HTTP/1.1" 200 None
2026-03-30 13:12:54 [auto1.fr] INFO: Scrape type for ZD76165: 0
2026-03-30 13:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:12:56 [auto1.fr] INFO: Channel: 24h | Page: 122 | totalHits: 5981 | hits on page: 40
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP61370%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for TP61370: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH45379%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for DH45379: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ09425%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for DJ09425: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX98718%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for AX98718: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX33425%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for SX33425: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT19778%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for VT19778: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB16314%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for HB16314: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG67142%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for JG67142: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD03654%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for PD03654: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ91470%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for TZ91470: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN14468%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for JN14468: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR68825%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for VR68825: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ33363%27 HTTP/1.1" 200 None
2026-03-30 13:12:56 [auto1.fr] INFO: Scrape type for NZ33363: 0
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 13:12:56 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 13:12:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:13:48 [scrapy.extensions.logstats] INFO: Crawled 376 pages (at 2 pages/min), scraped 231 items (at 0 items/min)
2026-03-30 13:13:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:14:48 [scrapy.extensions.logstats] INFO: Crawled 376 pages (at 0 pages/min), scraped 231 items (at 0 items/min)
2026-03-30 13:14:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:15:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.699(s), this was the 1st time calling it.
2026-03-30 13:15:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.815480696981297 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:15:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:16 [auto1.fr] INFO: Channel: 24h | Page: 123 | totalHits: 5991 | hits on page: 40
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 13:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR68825%27 HTTP/1.1" 200 None
2026-03-30 13:15:16 [auto1.fr] INFO: Scrape type for VR68825: 0
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 13:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ33363%27 HTTP/1.1" 200 None
2026-03-30 13:15:16 [auto1.fr] INFO: Scrape type for NZ33363: 0
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 13:15:16 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 13:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW31982%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for XW31982: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG29325%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for GG29325: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR32255%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for TR32255: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB94955%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for GB94955: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY43606%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for NY43606: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL62487%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for LL62487: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ26108%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for GZ26108: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW65969%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for HW65969: 0
2026-03-30 13:15:17 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH51958%27 HTTP/1.1" 200 None
2026-03-30 13:15:17 [auto1.fr] INFO: Scrape type for KH51958: 0
2026-03-30 13:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:21 [auto1.fr] INFO: Channel: 24h | Page: 124 | totalHits: 5991 | hits on page: 40
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG11231%27 HTTP/1.1" 200 None
2026-03-30 13:15:21 [auto1.fr] INFO: Scrape type for UG11231: 0
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK92055%27 HTTP/1.1" 200 None
2026-03-30 13:15:21 [auto1.fr] INFO: Scrape type for SK92055: 0
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP17198%27 HTTP/1.1" 200 None
2026-03-30 13:15:21 [auto1.fr] INFO: Scrape type for XP17198: 0
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU13538%27 HTTP/1.1" 200 None
2026-03-30 13:15:21 [auto1.fr] INFO: Scrape type for ZU13538: 0
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC00053%27 HTTP/1.1" 200 None
2026-03-30 13:15:21 [auto1.fr] INFO: Scrape type for KC00053: 0
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 13:15:21 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 13:15:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:35 [auto1.fr] INFO: Channel: 24h | Page: 125 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX17277%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for XX17277: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF14026%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for YF14026: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS03984%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for GS03984: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ30264%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for BZ30264: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC97617%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for SC97617: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP08474%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for FP08474: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA92859%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for MA92859: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS97221%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for NS97221: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP12584%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for NP12584: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV73236%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for WV73236: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN86171%27 HTTP/1.1" 200 None
2026-03-30 13:15:35 [auto1.fr] INFO: Scrape type for WN86171: 0
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 13:15:35 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 13:15:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:37 [auto1.fr] INFO: Channel: 24h | Page: 126 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 13:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD46957%27 HTTP/1.1" 200 None
2026-03-30 13:15:37 [auto1.fr] INFO: Scrape type for AD46957: 0
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 13:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS40917%27 HTTP/1.1" 200 None
2026-03-30 13:15:37 [auto1.fr] INFO: Scrape type for TS40917: 0
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 13:15:37 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 13:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS28661%27 HTTP/1.1" 200 None
2026-03-30 13:15:38 [auto1.fr] INFO: Scrape type for KS28661: 0
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH44031%27 HTTP/1.1" 200 None
2026-03-30 13:15:38 [auto1.fr] INFO: Scrape type for YH44031: 0
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE19039%27 HTTP/1.1" 200 None
2026-03-30 13:15:38 [auto1.fr] INFO: Scrape type for TE19039: 0
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA78315%27 HTTP/1.1" 200 None
2026-03-30 13:15:38 [auto1.fr] INFO: Scrape type for PA78315: 0
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 13:15:38 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 13:15:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:39 [auto1.fr] INFO: Channel: 24h | Page: 127 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV38858%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for UV38858: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS23730%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for DS23730: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL28145%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for ZL28145: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY97748%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for JY97748: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT64266%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for PT64266: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK47349%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for FK47349: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS96016%27 HTTP/1.1" 200 None
2026-03-30 13:15:39 [auto1.fr] INFO: Scrape type for PS96016: 0
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 13:15:39 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 13:15:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:41 [auto1.fr] INFO: Channel: 24h | Page: 128 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF56429%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for JF56429: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU33853%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for UU33853: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ91230%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for GZ91230: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA59282%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for XA59282: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV54644%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for LV54644: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ22347%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for MJ22347: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH55334%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for UH55334: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY42768%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for TY42768: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH28308%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for JH28308: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB52388%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for FB52388: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV29389%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for FV29389: 0
2026-03-30 13:15:41 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH74667%27 HTTP/1.1" 200 None
2026-03-30 13:15:41 [auto1.fr] INFO: Scrape type for AH74667: 0
2026-03-30 13:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:43 [auto1.fr] INFO: Channel: 24h | Page: 129 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM43773%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for YM43773: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH95044%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for LH95044: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF82485%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for VF82485: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC77691%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for SC77691: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR42714%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for CR42714: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD71096%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for PD71096: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE50651%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for JE50651: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX74554%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for PX74554: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC94374%27 HTTP/1.1" 200 None
2026-03-30 13:15:43 [auto1.fr] INFO: Scrape type for FC94374: 0
2026-03-30 13:15:43 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 13:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:44 [auto1.fr] INFO: Channel: 24h | Page: 130 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW58754%27 HTTP/1.1" 200 None
2026-03-30 13:15:44 [auto1.fr] INFO: Scrape type for RW58754: 0
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP33170%27 HTTP/1.1" 200 None
2026-03-30 13:15:44 [auto1.fr] INFO: Scrape type for GP33170: 0
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL53506%27 HTTP/1.1" 200 None
2026-03-30 13:15:44 [auto1.fr] INFO: Scrape type for EL53506: 0
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF65645%27 HTTP/1.1" 200 None
2026-03-30 13:15:44 [auto1.fr] INFO: Scrape type for HF65645: 0
2026-03-30 13:15:44 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 13:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ97980%27 HTTP/1.1" 200 None
2026-03-30 13:15:45 [auto1.fr] INFO: Scrape type for MZ97980: 0
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC84822%27 HTTP/1.1" 200 None
2026-03-30 13:15:45 [auto1.fr] INFO: Scrape type for DC84822: 0
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA71282%27 HTTP/1.1" 200 None
2026-03-30 13:15:45 [auto1.fr] INFO: Scrape type for RA71282: 0
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR16866%27 HTTP/1.1" 200 None
2026-03-30 13:15:45 [auto1.fr] INFO: Scrape type for XR16866: 0
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS23726%27 HTTP/1.1" 200 None
2026-03-30 13:15:45 [auto1.fr] INFO: Scrape type for VS23726: 0
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 13:15:45 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 13:15:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:48 [auto1.fr] INFO: Channel: 24h | Page: 131 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV57459%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for SV57459: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX76014%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for SX76014: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR93162%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for JR93162: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ82872%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for NJ82872: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB99439%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for AB99439: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL89237%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for WL89237: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP78557%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for FP78557: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH32796%27 HTTP/1.1" 200 None
2026-03-30 13:15:48 [auto1.fr] INFO: Scrape type for DH32796: 0
2026-03-30 13:15:48 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 13:15:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:48 [scrapy.extensions.logstats] INFO: Crawled 385 pages (at 9 pages/min), scraped 231 items (at 0 items/min)
2026-03-30 13:15:48 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:49 [auto1.fr] INFO: Channel: 24h | Page: 132 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG24879%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for KG24879: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ83397%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for SJ83397: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK50663%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for RK50663: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL32870%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for JL32870: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB72443%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for MB72443: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR38014%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for KR38014: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF22260%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for ZF22260: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ12195%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for LJ12195: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC53423%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for DC53423: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP92791%27 HTTP/1.1" 200 None
2026-03-30 13:15:49 [auto1.fr] INFO: Scrape type for EP92791: 0
2026-03-30 13:15:49 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 13:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:55 [auto1.fr] INFO: Channel: 24h | Page: 133 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR81420%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for WR81420: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV99015%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for LV99015: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF17635%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for SF17635: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE86900%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for NE86900: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF05733%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for GF05733: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA73207%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for BA73207: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU08648%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for VU08648: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG92228%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for GG92228: 0
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 13:15:55 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU05446%27 HTTP/1.1" 200 None
2026-03-30 13:15:55 [auto1.fr] INFO: Scrape type for SU05446: 0
2026-03-30 13:15:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:56 [auto1.fr] INFO: Channel: 24h | Page: 134 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC70489%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for EC70489: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH39112%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for FH39112: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM12499%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for KM12499: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD51164%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for WD51164: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF80923%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for FF80923: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP42522%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for DP42522: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ35948%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for TZ35948: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ95773%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for AZ95773: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY50281%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for FY50281: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV54294%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for XV54294: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL61645%27 HTTP/1.1" 200 None
2026-03-30 13:15:56 [auto1.fr] INFO: Scrape type for UL61645: 0
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 13:15:56 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 13:15:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:57 [auto1.fr] INFO: Channel: 24h | Page: 135 | totalHits: 5993 | hits on page: 40
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ48666%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for BJ48666: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT17592%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for RT17592: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ32569%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for VJ32569: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK58488%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for LK58488: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN84576%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for NN84576: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN90582%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for MN90582: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE39656%27 HTTP/1.1" 200 None
2026-03-30 13:15:57 [auto1.fr] INFO: Scrape type for DE39656: 0
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 13:15:57 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 13:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV56725%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for TV56725: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU54324%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for DU54324: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM83363%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for ZM83363: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR26119%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for AR26119: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ08565%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for DJ08565: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU11572%27 HTTP/1.1" 200 None
2026-03-30 13:15:58 [auto1.fr] INFO: Scrape type for TU11572: 0
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 13:15:58 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 13:15:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:15:59 [auto1.fr] INFO: Channel: 24h | Page: 136 | totalHits: 5994 | hits on page: 40
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF51870%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for PF51870: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE71774%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for BE71774: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL64757%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for JL64757: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH43807%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for PH43807: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW90901%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for MW90901: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ11851%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for RZ11851: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF48042%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for LF48042: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP93878%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for YP93878: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC56053%27 HTTP/1.1" 200 None
2026-03-30 13:15:59 [auto1.fr] INFO: Scrape type for MC56053: 0
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 13:15:59 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 13:15:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:15:59 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:00 [auto1.fr] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 842.5s). Queued for retry (1 pending).
2026-03-30 13:16:00 [auto1.fr] INFO: Initiating token refresh...
2026-03-30 13:16:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:03 [auto1.fr] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 13:16:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:04 [auto1.fr] INFO: Channel: 24h | Page: 137 | totalHits: 5995 | hits on page: 40
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG43228%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for XG43228: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL01176%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for CL01176: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT90818%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for XT90818: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC98017%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for SC98017: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY56545%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for AY56545: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25274%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for HD25274: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS45708%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for FS45708: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB79250%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for RB79250: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM10664%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for JM10664: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU84743%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for RU84743: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB12489%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for FB12489: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV45059%27 HTTP/1.1" 200 None
2026-03-30 13:16:04 [auto1.fr] INFO: Scrape type for DV45059: 0
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 13:16:04 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 13:16:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:08 [auto1.fr] INFO: Channel: 24h | Page: 138 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL49404%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for DL49404: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP92038%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for EP92038: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY94548%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for SY94548: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY16315%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for NY16315: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW12860%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for LW12860: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS60880%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for BS60880: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA38416%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for KA38416: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY49274%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for MY49274: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR01036%27 HTTP/1.1" 200 None
2026-03-30 13:16:08 [auto1.fr] INFO: Scrape type for YR01036: 0
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 13:16:08 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 13:16:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:10 [auto1.fr] INFO: Channel: 24h | Page: 139 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL36529%27 HTTP/1.1" 200 None
2026-03-30 13:16:10 [auto1.fr] INFO: Scrape type for EL36529: 0
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 13:16:10 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ17562%27 HTTP/1.1" 200 None
2026-03-30 13:16:10 [auto1.fr] INFO: Scrape type for XJ17562: 2
2026-03-30 13:16:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56454898-b791-5b50-a691-6b0341d5a857 with identifier: XJ17562
2026-03-30 13:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56454898-b791-5b50-a691-6b0341d5a857 with scrape type 2
2026-03-30 13:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56454898-b791-5b50-a691-6b0341d5a857 with scrape type 2
2026-03-30 13:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56454898-b791-5b50-a691-6b0341d5a857, identifier: XJ17562
2026-03-30 13:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56454898-b791-5b50-a691-6b0341d5a857 with identifier: XJ17562
2026-03-30 13:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56454898-b791-5b50-a691-6b0341d5a857 with identifier: XJ17562
2026-03-30 13:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56454898-b791-5b50-a691-6b0341d5a857 with identifier: XJ17562 to the API
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:59:34Z',
'fuel_type': 'petrol',
'id': '56454898-b791-5b50-a691-6b0341d5a857',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ17562',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 132431,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-25',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ17562%27 HTTP/1.1" 200 None
2026-03-30 13:16:10 [auto1.fr] INFO: Saving data for XJ17562: {'auction_closing_time': 1774886374.0, 'created_time': 1774696735.04661, 'last_price_update_time': 1774876570.957732}
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XJ17562') HTTP/1.1" 204 0
2026-03-30 13:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ17929%27 HTTP/1.1" 200 None
2026-03-30 13:16:11 [auto1.fr] INFO: Scrape type for GZ17929: 2
2026-03-30 13:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b5e32f-1f58-5efe-b363-27f45476414b with identifier: GZ17929
2026-03-30 13:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b5e32f-1f58-5efe-b363-27f45476414b with scrape type 2
2026-03-30 13:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25b5e32f-1f58-5efe-b363-27f45476414b with scrape type 2
2026-03-30 13:16:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25b5e32f-1f58-5efe-b363-27f45476414b, identifier: GZ17929
2026-03-30 13:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25b5e32f-1f58-5efe-b363-27f45476414b with identifier: GZ17929
2026-03-30 13:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25b5e32f-1f58-5efe-b363-27f45476414b with identifier: GZ17929
2026-03-30 13:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25b5e32f-1f58-5efe-b363-27f45476414b with identifier: GZ17929 to the API
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:16:40Z',
'fuel_type': 'petrol',
'id': '25b5e32f-1f58-5efe-b363-27f45476414b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ17929',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 109124,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2016}
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ17929%27 HTTP/1.1" 200 None
2026-03-30 13:16:11 [auto1.fr] INFO: Saving data for GZ17929: {'auction_closing_time': 1774883800.0, 'created_time': 1774696722.4424, 'last_price_update_time': 1774876571.477721}
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ17929') HTTP/1.1" 204 0
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 13:16:11 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD09782%27 HTTP/1.1" 200 None
2026-03-30 13:16:11 [auto1.fr] INFO: Scrape type for XD09782: 2
2026-03-30 13:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with identifier: XD09782
2026-03-30 13:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with scrape type 2
2026-03-30 13:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with scrape type 2
2026-03-30 13:16:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfd3c3c3-a0d5-518c-930c-ad0baa8869a8, identifier: XD09782
2026-03-30 13:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with identifier: XD09782
2026-03-30 13:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with identifier: XD09782
2026-03-30 13:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfd3c3c3-a0d5-518c-930c-ad0baa8869a8 with identifier: XD09782 to the API
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:37:16Z',
'fuel_type': 'diesel',
'id': 'bfd3c3c3-a0d5-518c-930c-ad0baa8869a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD09782',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 124490,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Creative 2WD',
'transmission': 'manual',
'trim': 'Creative 2WD',
'year': 2017}
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD09782%27 HTTP/1.1" 200 None
2026-03-30 13:16:11 [auto1.fr] INFO: Saving data for XD09782: {'auction_closing_time': 1774885036.0, 'created_time': 1774696721.123158, 'last_price_update_time': 1774876571.882041}
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XD09782') HTTP/1.1" 204 0
2026-03-30 13:16:12 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 13:16:12 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD57391%27 HTTP/1.1" 200 None
2026-03-30 13:16:12 [auto1.fr] INFO: Scrape type for RD57391: 2
2026-03-30 13:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d916666-a29a-514d-a229-f0ef3f05a45b with identifier: RD57391
2026-03-30 13:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d916666-a29a-514d-a229-f0ef3f05a45b with scrape type 2
2026-03-30 13:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d916666-a29a-514d-a229-f0ef3f05a45b with scrape type 2
2026-03-30 13:16:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d916666-a29a-514d-a229-f0ef3f05a45b, identifier: RD57391
2026-03-30 13:16:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d916666-a29a-514d-a229-f0ef3f05a45b with identifier: RD57391
2026-03-30 13:16:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d916666-a29a-514d-a229-f0ef3f05a45b with identifier: RD57391
2026-03-30 13:16:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d916666-a29a-514d-a229-f0ef3f05a45b with identifier: RD57391 to the API
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:10Z',
'fuel_type': 'petrol',
'id': '6d916666-a29a-514d-a229-f0ef3f05a45b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD57391',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 84685,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2021}
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD57391%27 HTTP/1.1" 200 None
2026-03-30 13:16:12 [auto1.fr] INFO: Saving data for RD57391: {'auction_closing_time': 1774884370.0, 'created_time': 1774696734.555209, 'last_price_update_time': 1774876572.455356}
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD57391') HTTP/1.1" 204 0
2026-03-30 13:16:12 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 13:16:12 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX27000%27 HTTP/1.1" 200 None
2026-03-30 13:16:12 [auto1.fr] INFO: Scrape type for FX27000: 2
2026-03-30 13:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3aa9584-3497-57f3-8cf0-01efe26e82ae with identifier: FX27000
2026-03-30 13:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3aa9584-3497-57f3-8cf0-01efe26e82ae with scrape type 2
2026-03-30 13:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3aa9584-3497-57f3-8cf0-01efe26e82ae with scrape type 2
2026-03-30 13:16:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3aa9584-3497-57f3-8cf0-01efe26e82ae, identifier: FX27000
2026-03-30 13:16:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3aa9584-3497-57f3-8cf0-01efe26e82ae with identifier: FX27000
2026-03-30 13:16:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3aa9584-3497-57f3-8cf0-01efe26e82ae with identifier: FX27000
2026-03-30 13:16:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3aa9584-3497-57f3-8cf0-01efe26e82ae with identifier: FX27000 to the API
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:58:59Z',
'fuel_type': 'petrol',
'id': 'a3aa9584-3497-57f3-8cf0-01efe26e82ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX27000',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 133118,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-06',
'seller_name': None,
'title': 'Peugeot 207 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2007}
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX27000%27 HTTP/1.1" 200 None
2026-03-30 13:16:12 [auto1.fr] INFO: Saving data for FX27000: {'auction_closing_time': 1774886339.0, 'created_time': 1772949764.730742, 'last_price_update_time': 1774876572.982351}
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX27000') HTTP/1.1" 204 0
2026-03-30 13:16:13 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG14928%27 HTTP/1.1" 200 None
2026-03-30 13:16:13 [auto1.fr] INFO: Scrape type for ZG14928: 2
2026-03-30 13:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea199356-ef2c-5382-bb83-3c1f59ab3e83 with identifier: ZG14928
2026-03-30 13:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea199356-ef2c-5382-bb83-3c1f59ab3e83 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea199356-ef2c-5382-bb83-3c1f59ab3e83 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea199356-ef2c-5382-bb83-3c1f59ab3e83, identifier: ZG14928
2026-03-30 13:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea199356-ef2c-5382-bb83-3c1f59ab3e83 with identifier: ZG14928
2026-03-30 13:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea199356-ef2c-5382-bb83-3c1f59ab3e83 with identifier: ZG14928
2026-03-30 13:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea199356-ef2c-5382-bb83-3c1f59ab3e83 with identifier: ZG14928 to the API
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:43:18Z',
'fuel_type': 'petrol',
'id': 'ea199356-ef2c-5382-bb83-3c1f59ab3e83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG14928',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 120103,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-21',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG14928%27 HTTP/1.1" 200 None
2026-03-30 13:16:13 [auto1.fr] INFO: Saving data for ZG14928: {'auction_closing_time': 1774885398.0, 'created_time': 1774080940.706128, 'last_price_update_time': 1774876573.404298}
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG14928') HTTP/1.1" 204 0
2026-03-30 13:16:13 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ99461%27 HTTP/1.1" 200 None
2026-03-30 13:16:13 [auto1.fr] INFO: Scrape type for WZ99461: 2
2026-03-30 13:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd10e325-09b8-5b29-af80-4567ecbdec13 with identifier: WZ99461
2026-03-30 13:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd10e325-09b8-5b29-af80-4567ecbdec13 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd10e325-09b8-5b29-af80-4567ecbdec13 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd10e325-09b8-5b29-af80-4567ecbdec13, identifier: WZ99461
2026-03-30 13:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd10e325-09b8-5b29-af80-4567ecbdec13 with identifier: WZ99461
2026-03-30 13:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd10e325-09b8-5b29-af80-4567ecbdec13 with identifier: WZ99461
2026-03-30 13:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd10e325-09b8-5b29-af80-4567ecbdec13 with identifier: WZ99461 to the API
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:02Z',
'fuel_type': 'petrol',
'id': 'bd10e325-09b8-5b29-af80-4567ecbdec13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ99461',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 36740,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Sunshine',
'transmission': 'manual',
'trim': 'Sunshine',
'year': 2018}
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ99461%27 HTTP/1.1" 200 None
2026-03-30 13:16:13 [auto1.fr] INFO: Saving data for WZ99461: {'auction_closing_time': 1774885802.0, 'created_time': 1773937535.331089, 'last_price_update_time': 1774876573.822706}
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WZ99461') HTTP/1.1" 204 0
2026-03-30 13:16:13 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT48386%27 HTTP/1.1" 200 None
2026-03-30 13:16:13 [auto1.fr] INFO: Scrape type for AT48386: 2
2026-03-30 13:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374a8848-0c87-5a8c-953a-c69f3546ba78 with identifier: AT48386
2026-03-30 13:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374a8848-0c87-5a8c-953a-c69f3546ba78 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 374a8848-0c87-5a8c-953a-c69f3546ba78 with scrape type 2
2026-03-30 13:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 374a8848-0c87-5a8c-953a-c69f3546ba78, identifier: AT48386
2026-03-30 13:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 374a8848-0c87-5a8c-953a-c69f3546ba78 with identifier: AT48386
2026-03-30 13:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 374a8848-0c87-5a8c-953a-c69f3546ba78 with identifier: AT48386
2026-03-30 13:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 374a8848-0c87-5a8c-953a-c69f3546ba78 with identifier: AT48386 to the API
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:28:33Z',
'fuel_type': 'petrol',
'id': '374a8848-0c87-5a8c-953a-c69f3546ba78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT48386',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 147281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-19',
'seller_name': None,
'title': 'Citroen C4 1.2 e-THP Millenium Business',
'transmission': 'manual',
'trim': 'Millenium Business',
'year': 2016}
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT48386%27 HTTP/1.1" 200 None
2026-03-30 13:16:14 [auto1.fr] INFO: Saving data for AT48386: {'auction_closing_time': 1774884513.0, 'created_time': 1774696717.055006, 'last_price_update_time': 1774876574.256191}
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AT48386') HTTP/1.1" 204 0
2026-03-30 13:16:14 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU76278%27 HTTP/1.1" 200 None
2026-03-30 13:16:14 [auto1.fr] INFO: Scrape type for LU76278: 2
2026-03-30 13:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with identifier: LU76278
2026-03-30 13:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with scrape type 2
2026-03-30 13:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with scrape type 2
2026-03-30 13:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8914e33-a45d-5ed1-9680-20cd70cd4aa2, identifier: LU76278
2026-03-30 13:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with identifier: LU76278
2026-03-30 13:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with identifier: LU76278
2026-03-30 13:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8914e33-a45d-5ed1-9680-20cd70cd4aa2 with identifier: LU76278 to the API
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:52:52Z',
'fuel_type': 'diesel',
'id': 'e8914e33-a45d-5ed1-9680-20cd70cd4aa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU76278',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 216718,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-24',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Millenium',
'transmission': 'manual',
'trim': 'Millenium',
'year': 2015}
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU76278%27 HTTP/1.1" 200 None
2026-03-30 13:16:14 [auto1.fr] INFO: Saving data for LU76278: {'auction_closing_time': 1774885972.0, 'created_time': 1774354744.976574, 'last_price_update_time': 1774876574.643889}
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LU76278') HTTP/1.1" 204 0
2026-03-30 13:16:14 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 13:16:14 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 13:16:14 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 13:16:14 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL52306%27 HTTP/1.1" 200 None
2026-03-30 13:16:14 [auto1.fr] INFO: Scrape type for ZL52306: 2
2026-03-30 13:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with identifier: ZL52306
2026-03-30 13:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with scrape type 2
2026-03-30 13:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with scrape type 2
2026-03-30 13:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa, identifier: ZL52306
2026-03-30 13:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with identifier: ZL52306
2026-03-30 13:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with identifier: ZL52306
2026-03-30 13:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa with identifier: ZL52306 to the API
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:49:18Z',
'fuel_type': 'petrol',
'id': '7a9df799-cc7b-50a6-8d97-c8b0bbaf9faa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL52306',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 87789,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-27',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL52306%27 HTTP/1.1" 200 None
2026-03-30 13:16:15 [auto1.fr] INFO: Saving data for ZL52306: {'auction_closing_time': 1774885758.0, 'created_time': 1773335754.005445, 'last_price_update_time': 1774876575.069383}
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL52306') HTTP/1.1" 204 0
2026-03-30 13:16:15 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 13:16:15 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 13:16:15 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH92238%27 HTTP/1.1" 200 None
2026-03-30 13:16:15 [auto1.fr] INFO: Scrape type for HH92238: 2
2026-03-30 13:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with identifier: HH92238
2026-03-30 13:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with scrape type 2
2026-03-30 13:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with scrape type 2
2026-03-30 13:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a, identifier: HH92238
2026-03-30 13:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with identifier: HH92238
2026-03-30 13:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with identifier: HH92238
2026-03-30 13:16:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a with identifier: HH92238 to the API
2026-03-30 13:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:52:33Z',
'fuel_type': 'diesel',
'id': 'bea6ca17-e1d0-5a0c-9475-3ef0c74d8d1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH92238',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 175543,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'Renault Grand Scenic 1.6 dCi Energy Bose',
'transmission': 'manual',
'trim': 'Bose',
'year': 2013}
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH92238%27 HTTP/1.1" 200 None
2026-03-30 13:16:16 [auto1.fr] INFO: Saving data for HH92238: {'auction_closing_time': 1774885953.0, 'created_time': 1773837865.722483, 'last_price_update_time': 1774876576.470794}
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HH92238') HTTP/1.1" 204 0
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 13:16:16 [auto1.fr] INFO: Channel: 24h | Page: 140 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 13:16:16 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ28866%27 HTTP/1.1" 200 None
2026-03-30 13:16:16 [auto1.fr] INFO: Scrape type for DZ28866: 2
2026-03-30 13:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with identifier: DZ28866
2026-03-30 13:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with scrape type 2
2026-03-30 13:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with scrape type 2
2026-03-30 13:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3f80d76-d0db-5ac5-9235-6e0fd9df20a7, identifier: DZ28866
2026-03-30 13:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with identifier: DZ28866
2026-03-30 13:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with identifier: DZ28866
2026-03-30 13:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3f80d76-d0db-5ac5-9235-6e0fd9df20a7 with identifier: DZ28866 to the API
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:16:02Z',
'fuel_type': 'petrol',
'id': 'e3f80d76-d0db-5ac5-9235-6e0fd9df20a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ28866',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 19230,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seller_name': None,
'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid High Altitude FWD',
'transmission': 'automatic',
'trim': 'High Altitude FWD',
'year': 2023}
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ28866%27 HTTP/1.1" 200 None
2026-03-30 13:16:16 [auto1.fr] INFO: Saving data for DZ28866: {'auction_closing_time': 1774883762.0, 'created_time': 1774091817.299998, 'last_price_update_time': 1774876576.981621}
2026-03-30 13:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DZ28866') HTTP/1.1" 204 0
2026-03-30 13:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH82114%27 HTTP/1.1" 200 None
2026-03-30 13:16:17 [auto1.fr] INFO: Scrape type for KH82114: 2
2026-03-30 13:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with identifier: KH82114
2026-03-30 13:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with scrape type 2
2026-03-30 13:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with scrape type 2
2026-03-30 13:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 54d4f111-a510-5b82-8ad5-61c56ab8c2c0, identifier: KH82114
2026-03-30 13:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with identifier: KH82114
2026-03-30 13:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with identifier: KH82114
2026-03-30 13:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 54d4f111-a510-5b82-8ad5-61c56ab8c2c0 with identifier: KH82114 to the API
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:58:45Z',
'fuel_type': 'diesel',
'id': '54d4f111-a510-5b82-8ad5-61c56ab8c2c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH82114',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 164043,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-07',
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Luna',
'transmission': 'manual',
'trim': 'Luna',
'year': 2008}
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH82114%27 HTTP/1.1" 200 None
2026-03-30 13:16:17 [auto1.fr] INFO: Saving data for KH82114: {'auction_closing_time': 1774886325.0, 'created_time': 1774696733.640978, 'last_price_update_time': 1774876577.46086}
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH82114') HTTP/1.1" 204 0
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM37539%27 HTTP/1.1" 200 None
2026-03-30 13:16:17 [auto1.fr] INFO: Scrape type for WM37539: 2
2026-03-30 13:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec71ba6-b132-507c-85b6-c1086b252382 with identifier: WM37539
2026-03-30 13:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec71ba6-b132-507c-85b6-c1086b252382 with scrape type 2
2026-03-30 13:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec71ba6-b132-507c-85b6-c1086b252382 with scrape type 2
2026-03-30 13:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ec71ba6-b132-507c-85b6-c1086b252382, identifier: WM37539
2026-03-30 13:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ec71ba6-b132-507c-85b6-c1086b252382 with identifier: WM37539
2026-03-30 13:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ec71ba6-b132-507c-85b6-c1086b252382 with identifier: WM37539
2026-03-30 13:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ec71ba6-b132-507c-85b6-c1086b252382 with identifier: WM37539 to the API
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:56:57Z',
'fuel_type': 'hybrid',
'id': '7ec71ba6-b132-507c-85b6-c1086b252382',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM37539',
'listing': 'auction',
'make': 'Lexus',
'model': 'CT-Serie',
'odometer': 178984,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-06',
'seller_name': None,
'title': 'Lexus CT-Serie CT 200h Sensation',
'transmission': 'automatic',
'trim': 'Sensation',
'year': 2011}
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM37539%27 HTTP/1.1" 200 None
2026-03-30 13:16:17 [auto1.fr] INFO: Saving data for WM37539: {'auction_closing_time': 1774886217.0, 'created_time': 1774696719.674888, 'last_price_update_time': 1774876577.850399}
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM37539') HTTP/1.1" 204 0
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE59184%27 HTTP/1.1" 200 None
2026-03-30 13:16:17 [auto1.fr] INFO: Scrape type for HE59184: 0
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 13:16:17 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 13:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP03008%27 HTTP/1.1" 200 None
2026-03-30 13:16:18 [auto1.fr] INFO: Scrape type for PP03008: 2
2026-03-30 13:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7da467-8a67-53ce-a768-5ebd4d8361ab with identifier: PP03008
2026-03-30 13:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7da467-8a67-53ce-a768-5ebd4d8361ab with scrape type 2
2026-03-30 13:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7da467-8a67-53ce-a768-5ebd4d8361ab with scrape type 2
2026-03-30 13:16:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a7da467-8a67-53ce-a768-5ebd4d8361ab, identifier: PP03008
2026-03-30 13:16:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a7da467-8a67-53ce-a768-5ebd4d8361ab with identifier: PP03008
2026-03-30 13:16:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a7da467-8a67-53ce-a768-5ebd4d8361ab with identifier: PP03008
2026-03-30 13:16:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a7da467-8a67-53ce-a768-5ebd4d8361ab with identifier: PP03008 to the API
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:58:48Z',
'fuel_type': 'diesel',
'id': '8a7da467-8a67-53ce-a768-5ebd4d8361ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP03008',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 279435,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-27',
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi 170 C Confort',
'transmission': 'manual',
'trim': '170 C Confort',
'year': 2008}
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP03008%27 HTTP/1.1" 200 None
2026-03-30 13:16:18 [auto1.fr] INFO: Saving data for PP03008: {'auction_closing_time': 1774886328.0, 'created_time': 1772617599.073817, 'last_price_update_time': 1774876578.535725}
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PP03008') HTTP/1.1" 204 0
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 13:16:18 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG89376%27 HTTP/1.1" 200 None
2026-03-30 13:16:18 [auto1.fr] INFO: Scrape type for ZG89376: 2
2026-03-30 13:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with identifier: ZG89376
2026-03-30 13:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with scrape type 2
2026-03-30 13:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with scrape type 2
2026-03-30 13:16:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0, identifier: ZG89376
2026-03-30 13:16:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with identifier: ZG89376
2026-03-30 13:16:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with identifier: ZG89376
2026-03-30 13:16:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0 with identifier: ZG89376 to the API
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:23:03Z',
'fuel_type': 'petrol',
'id': '34f4cc08-8873-5e30-85eb-c3d8bc2d9ec0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG89376',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 247765,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-12-30',
'seller_name': None,
'title': 'Renault Megane 1.4 RN',
'transmission': 'manual',
'trim': 'RN',
'year': 1998}
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG89376%27 HTTP/1.1" 200 None
2026-03-30 13:16:18 [auto1.fr] INFO: Saving data for ZG89376: {'auction_closing_time': 1774884183.0, 'created_time': 1774696749.238001, 'last_price_update_time': 1774876578.974793}
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG89376') HTTP/1.1" 204 0
2026-03-30 13:16:19 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 13:16:19 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 13:16:19 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 13:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ03842%27 HTTP/1.1" 200 None
2026-03-30 13:16:19 [auto1.fr] INFO: Scrape type for TJ03842: 2
2026-03-30 13:16:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with identifier: TJ03842
2026-03-30 13:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with scrape type 2
2026-03-30 13:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with scrape type 2
2026-03-30 13:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5e26c57-dab4-59e7-b605-33a2c7f75ec5, identifier: TJ03842
2026-03-30 13:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with identifier: TJ03842
2026-03-30 13:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with identifier: TJ03842
2026-03-30 13:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5e26c57-dab4-59e7-b605-33a2c7f75ec5 with identifier: TJ03842 to the API
2026-03-30 13:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:15:15Z',
'fuel_type': 'diesel',
'id': 'b5e26c57-dab4-59e7-b605-33a2c7f75ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ03842',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 166653,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-29',
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI 150 Jahre Opel',
'transmission': 'manual',
'trim': '150 Jahre',
'year': 2012}
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ03842%27 HTTP/1.1" 200 None
2026-03-30 13:16:20 [auto1.fr] INFO: Saving data for TJ03842: {'auction_closing_time': 1774883715.0, 'created_time': 1774696793.850679, 'last_price_update_time': 1774876580.756809}
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ03842') HTTP/1.1" 204 0
2026-03-30 13:16:20 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 13:16:20 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS71698%27 HTTP/1.1" 200 None
2026-03-30 13:16:20 [auto1.fr] INFO: Scrape type for VS71698: 2
2026-03-30 13:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5625933-67f9-5334-8f4e-0affbdf4ebc9 with identifier: VS71698
2026-03-30 13:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5625933-67f9-5334-8f4e-0affbdf4ebc9 with scrape type 2
2026-03-30 13:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5625933-67f9-5334-8f4e-0affbdf4ebc9 with scrape type 2
2026-03-30 13:16:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5625933-67f9-5334-8f4e-0affbdf4ebc9, identifier: VS71698
2026-03-30 13:16:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5625933-67f9-5334-8f4e-0affbdf4ebc9 with identifier: VS71698
2026-03-30 13:16:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5625933-67f9-5334-8f4e-0affbdf4ebc9 with identifier: VS71698
2026-03-30 13:16:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5625933-67f9-5334-8f4e-0affbdf4ebc9 with identifier: VS71698 to the API
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': 'd5625933-67f9-5334-8f4e-0affbdf4ebc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS71698',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa Brera',
'odometer': 94888,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-31',
'seller_name': None,
'title': 'Alfa Romeo Alfa Brera 2.4 JTDM',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS71698%27 HTTP/1.1" 200 None
2026-03-30 13:16:21 [auto1.fr] INFO: Saving data for VS71698: {'auction_closing_time': 1774885528.0, 'created_time': 1774696735.849276, 'last_price_update_time': 1774876581.546612}
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS71698') HTTP/1.1" 204 0
2026-03-30 13:16:21 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 13:16:21 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 13:16:21 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 13:16:21 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC48174%27 HTTP/1.1" 200 None
2026-03-30 13:16:21 [auto1.fr] INFO: Scrape type for WC48174: 2
2026-03-30 13:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-03-30 13:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5067be82-33c5-5062-88c8-6911d1fceafb with scrape type 2
2026-03-30 13:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5067be82-33c5-5062-88c8-6911d1fceafb with scrape type 2
2026-03-30 13:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5067be82-33c5-5062-88c8-6911d1fceafb, identifier: WC48174
2026-03-30 13:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-03-30 13:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-03-30 13:16:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174 to the API
2026-03-30 13:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:16Z',
'fuel_type': 'diesel',
'id': '5067be82-33c5-5062-88c8-6911d1fceafb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC48174',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 249437,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-29',
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2010}
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC48174%27 HTTP/1.1" 200 None
2026-03-30 13:16:22 [auto1.fr] INFO: Saving data for WC48174: {'auction_closing_time': 1774884976.0, 'created_time': 1774005399.956618, 'last_price_update_time': 1774876582.249337}
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WC48174') HTTP/1.1" 204 0
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE27951%27 HTTP/1.1" 200 None
2026-03-30 13:16:22 [auto1.fr] INFO: Scrape type for FE27951: 2
2026-03-30 13:16:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with identifier: FE27951
2026-03-30 13:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with scrape type 2
2026-03-30 13:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with scrape type 2
2026-03-30 13:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef, identifier: FE27951
2026-03-30 13:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with identifier: FE27951
2026-03-30 13:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with identifier: FE27951
2026-03-30 13:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5e6b59a6-13b2-5839-95c1-f0f31c3d36ef with identifier: FE27951 to the API
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:38:37Z',
'fuel_type': 'diesel',
'id': '5e6b59a6-13b2-5839-95c1-f0f31c3d36ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE27951',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 127237,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-18',
'seller_name': None,
'title': 'BMW 2er 216d Active Tourer Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE27951%27 HTTP/1.1" 200 None
2026-03-30 13:16:22 [auto1.fr] INFO: Saving data for FE27951: {'auction_closing_time': 1774885117.0, 'created_time': 1774019754.726968, 'last_price_update_time': 1774876582.641258}
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FE27951') HTTP/1.1" 204 0
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 13:16:22 [auto1.fr] INFO: Channel: 24h | Page: 141 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 13:16:22 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT35695%27 HTTP/1.1" 200 None
2026-03-30 13:16:22 [auto1.fr] INFO: Scrape type for XT35695: 2
2026-03-30 13:16:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 684d3a90-f80b-51cb-95e8-55cc866a81f1 with identifier: XT35695
2026-03-30 13:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 684d3a90-f80b-51cb-95e8-55cc866a81f1 with scrape type 2
2026-03-30 13:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 684d3a90-f80b-51cb-95e8-55cc866a81f1 with scrape type 2
2026-03-30 13:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 684d3a90-f80b-51cb-95e8-55cc866a81f1, identifier: XT35695
2026-03-30 13:16:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 684d3a90-f80b-51cb-95e8-55cc866a81f1 with identifier: XT35695
2026-03-30 13:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 684d3a90-f80b-51cb-95e8-55cc866a81f1 with identifier: XT35695
2026-03-30 13:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 684d3a90-f80b-51cb-95e8-55cc866a81f1 with identifier: XT35695 to the API
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:10:43Z',
'fuel_type': 'petrol',
'id': '684d3a90-f80b-51cb-95e8-55cc866a81f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT35695',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 34944,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-09-29',
'seller_name': None,
'title': 'Renault Twingo 1.2',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT35695%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Saving data for XT35695: {'auction_closing_time': 1774883443.0, 'created_time': 1774696738.852117, 'last_price_update_time': 1774876583.047601}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XT35695') HTTP/1.1" 204 0
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP99066%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Scrape type for KP99066: 2
2026-03-30 13:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c1f2e26-7b49-53ba-afdd-81562207b500 with identifier: KP99066
2026-03-30 13:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c1f2e26-7b49-53ba-afdd-81562207b500 with scrape type 2
2026-03-30 13:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c1f2e26-7b49-53ba-afdd-81562207b500 with scrape type 2
2026-03-30 13:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c1f2e26-7b49-53ba-afdd-81562207b500, identifier: KP99066
2026-03-30 13:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c1f2e26-7b49-53ba-afdd-81562207b500 with identifier: KP99066
2026-03-30 13:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c1f2e26-7b49-53ba-afdd-81562207b500 with identifier: KP99066
2026-03-30 13:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c1f2e26-7b49-53ba-afdd-81562207b500 with identifier: KP99066 to the API
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:08Z',
'fuel_type': 'petrol',
'id': '0c1f2e26-7b49-53ba-afdd-81562207b500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP99066',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 164598,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-13',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP99066%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Saving data for KP99066: {'auction_closing_time': 1774883948.0, 'created_time': 1774696738.250619, 'last_price_update_time': 1774876583.559427}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KP99066') HTTP/1.1" 204 0
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP27758%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Scrape type for MP27758: 2
2026-03-30 13:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 995ed639-3683-5f01-b64a-c045a14d8558 with identifier: MP27758
2026-03-30 13:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 995ed639-3683-5f01-b64a-c045a14d8558 with scrape type 2
2026-03-30 13:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 995ed639-3683-5f01-b64a-c045a14d8558 with scrape type 2
2026-03-30 13:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 995ed639-3683-5f01-b64a-c045a14d8558, identifier: MP27758
2026-03-30 13:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 995ed639-3683-5f01-b64a-c045a14d8558 with identifier: MP27758
2026-03-30 13:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 995ed639-3683-5f01-b64a-c045a14d8558 with identifier: MP27758
2026-03-30 13:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 995ed639-3683-5f01-b64a-c045a14d8558 with identifier: MP27758 to the API
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:02:56Z',
'fuel_type': 'diesel',
'id': '995ed639-3683-5f01-b64a-c045a14d8558',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP27758',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 354202,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-17',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP27758%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Saving data for MP27758: {'auction_closing_time': 1774882976.0, 'created_time': 1774696886.227835, 'last_price_update_time': 1774876583.950246}
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP27758') HTTP/1.1" 204 0
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 13:16:23 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG82856%27 HTTP/1.1" 200 None
2026-03-30 13:16:23 [auto1.fr] INFO: Scrape type for DG82856: 2
2026-03-30 13:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with identifier: DG82856
2026-03-30 13:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with scrape type 2
2026-03-30 13:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with scrape type 2
2026-03-30 13:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16bbabfb-8dc8-5f07-9619-e0f81aee1212, identifier: DG82856
2026-03-30 13:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with identifier: DG82856
2026-03-30 13:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with identifier: DG82856
2026-03-30 13:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16bbabfb-8dc8-5f07-9619-e0f81aee1212 with identifier: DG82856 to the API
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:56:31Z',
'fuel_type': 'diesel',
'id': '16bbabfb-8dc8-5f07-9619-e0f81aee1212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG82856',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 308883,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-08-31',
'seller_name': None,
'title': 'Volkswagen Passat 1.9 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2003}
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG82856%27 HTTP/1.1" 200 None
2026-03-30 13:16:24 [auto1.fr] INFO: Saving data for DG82856: {'auction_closing_time': 1774886191.0, 'created_time': 1774696875.140647, 'last_price_update_time': 1774876584.447386}
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG82856') HTTP/1.1" 204 0
2026-03-30 13:16:24 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 13:16:24 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU39800%27 HTTP/1.1" 200 None
2026-03-30 13:16:24 [auto1.fr] INFO: Scrape type for EU39800: 2
2026-03-30 13:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de44bcb-fa95-5282-b06a-b57e200b9d3e with identifier: EU39800
2026-03-30 13:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de44bcb-fa95-5282-b06a-b57e200b9d3e with scrape type 2
2026-03-30 13:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de44bcb-fa95-5282-b06a-b57e200b9d3e with scrape type 2
2026-03-30 13:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9de44bcb-fa95-5282-b06a-b57e200b9d3e, identifier: EU39800
2026-03-30 13:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9de44bcb-fa95-5282-b06a-b57e200b9d3e with identifier: EU39800
2026-03-30 13:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9de44bcb-fa95-5282-b06a-b57e200b9d3e with identifier: EU39800
2026-03-30 13:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9de44bcb-fa95-5282-b06a-b57e200b9d3e with identifier: EU39800 to the API
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:01:00Z',
'fuel_type': 'petrol',
'id': '9de44bcb-fa95-5282-b06a-b57e200b9d3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU39800',
'listing': 'auction',
'make': 'Peugeot',
'model': '206+',
'odometer': 166682,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-30',
'seller_name': None,
'title': 'Peugeot 206+ 1.4 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2009}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU39800%27 HTTP/1.1" 200 None
2026-03-30 13:16:25 [auto1.fr] INFO: Saving data for EU39800: {'auction_closing_time': 1774882860.0, 'created_time': 1774696748.657195, 'last_price_update_time': 1774876585.047338}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU39800') HTTP/1.1" 204 0
2026-03-30 13:16:25 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 13:16:25 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV10039%27 HTTP/1.1" 200 None
2026-03-30 13:16:25 [auto1.fr] INFO: Scrape type for SV10039: 2
2026-03-30 13:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5ac019-dfc8-5c13-84a7-298793dcc51b with identifier: SV10039
2026-03-30 13:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5ac019-dfc8-5c13-84a7-298793dcc51b with scrape type 2
2026-03-30 13:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5ac019-dfc8-5c13-84a7-298793dcc51b with scrape type 2
2026-03-30 13:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a5ac019-dfc8-5c13-84a7-298793dcc51b, identifier: SV10039
2026-03-30 13:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a5ac019-dfc8-5c13-84a7-298793dcc51b with identifier: SV10039
2026-03-30 13:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a5ac019-dfc8-5c13-84a7-298793dcc51b with identifier: SV10039
2026-03-30 13:16:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a5ac019-dfc8-5c13-84a7-298793dcc51b with identifier: SV10039 to the API
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:32:54Z',
'fuel_type': 'diesel',
'id': '8a5ac019-dfc8-5c13-84a7-298793dcc51b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV10039',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 119041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-30',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV10039%27 HTTP/1.1" 200 None
2026-03-30 13:16:25 [auto1.fr] INFO: Saving data for SV10039: {'auction_closing_time': 1774884774.0, 'created_time': 1774696741.953345, 'last_price_update_time': 1774876585.543922}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV10039') HTTP/1.1" 204 0
2026-03-30 13:16:25 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX05751%27 HTTP/1.1" 200 None
2026-03-30 13:16:25 [auto1.fr] INFO: Scrape type for BX05751: 2
2026-03-30 13:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b903e32d-4b10-5b9d-b780-cd6469199235 with identifier: BX05751
2026-03-30 13:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b903e32d-4b10-5b9d-b780-cd6469199235 with scrape type 2
2026-03-30 13:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b903e32d-4b10-5b9d-b780-cd6469199235 with scrape type 2
2026-03-30 13:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b903e32d-4b10-5b9d-b780-cd6469199235, identifier: BX05751
2026-03-30 13:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b903e32d-4b10-5b9d-b780-cd6469199235 with identifier: BX05751
2026-03-30 13:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b903e32d-4b10-5b9d-b780-cd6469199235 with identifier: BX05751
2026-03-30 13:16:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b903e32d-4b10-5b9d-b780-cd6469199235 with identifier: BX05751 to the API
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:35:36Z',
'fuel_type': 'gas',
'id': 'b903e32d-4b10-5b9d-b780-cd6469199235',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX05751',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 41008,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression',
'transmission': 'manual',
'trim': 'Stepway Expression',
'year': 2023}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX05751%27 HTTP/1.1" 200 None
2026-03-30 13:16:25 [auto1.fr] INFO: Saving data for BX05751: {'auction_closing_time': 1774884936.0, 'created_time': 1774696892.994187, 'last_price_update_time': 1774876585.968806}
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX05751') HTTP/1.1" 204 0
2026-03-30 13:16:25 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 13:16:25 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 13:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ06950%27 HTTP/1.1" 200 None
2026-03-30 13:16:26 [auto1.fr] INFO: Scrape type for PZ06950: 2
2026-03-30 13:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 527fa52a-ee33-5381-938a-2e29e568e9a6 with identifier: PZ06950
2026-03-30 13:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 527fa52a-ee33-5381-938a-2e29e568e9a6 with scrape type 2
2026-03-30 13:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 527fa52a-ee33-5381-938a-2e29e568e9a6 with scrape type 2
2026-03-30 13:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 527fa52a-ee33-5381-938a-2e29e568e9a6, identifier: PZ06950
2026-03-30 13:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 527fa52a-ee33-5381-938a-2e29e568e9a6 with identifier: PZ06950
2026-03-30 13:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 527fa52a-ee33-5381-938a-2e29e568e9a6 with identifier: PZ06950
2026-03-30 13:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 527fa52a-ee33-5381-938a-2e29e568e9a6 with identifier: PZ06950 to the API
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:57:57Z',
'fuel_type': 'diesel',
'id': '527fa52a-ee33-5381-938a-2e29e568e9a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ06950',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 198016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2017}
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ06950%27 HTTP/1.1" 200 None
2026-03-30 13:16:26 [auto1.fr] INFO: Saving data for PZ06950: {'auction_closing_time': 1774886277.0, 'created_time': 1774696885.584869, 'last_price_update_time': 1774876586.439991}
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ06950') HTTP/1.1" 204 0
2026-03-30 13:16:26 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 13:16:26 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 13:16:26 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 13:16:26 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 13:16:26 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR59286%27 HTTP/1.1" 200 None
2026-03-30 13:16:26 [auto1.fr] INFO: Scrape type for TR59286: 2
2026-03-30 13:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c983eac9-b45f-5b53-9e2c-955286055b14 with identifier: TR59286
2026-03-30 13:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c983eac9-b45f-5b53-9e2c-955286055b14 with scrape type 2
2026-03-30 13:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c983eac9-b45f-5b53-9e2c-955286055b14 with scrape type 2
2026-03-30 13:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c983eac9-b45f-5b53-9e2c-955286055b14, identifier: TR59286
2026-03-30 13:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c983eac9-b45f-5b53-9e2c-955286055b14 with identifier: TR59286
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 13:16:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 13:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c983eac9-b45f-5b53-9e2c-955286055b14 with identifier: TR59286
2026-03-30 13:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c983eac9-b45f-5b53-9e2c-955286055b14 with identifier: TR59286 to the API
2026-03-30 13:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:43:57Z',
'fuel_type': 'electro',
'id': 'c983eac9-b45f-5b53-9e2c-955286055b14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR59286',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 107324,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-28',
'seller_name': None,
'title': 'Opel Mokka X electric drive 100 kW Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR59286%27 HTTP/1.1" 200 None
2026-03-30 13:16:27 [auto1.fr] INFO: Saving data for TR59286: {'auction_closing_time': 1774885437.0, 'created_time': 1774019752.262228, 'last_price_update_time': 1774876587.145619}
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR59286') HTTP/1.1" 204 0
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX21157%27 HTTP/1.1" 200 None
2026-03-30 13:16:27 [auto1.fr] INFO: Scrape type for WX21157: 2
2026-03-30 13:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7261993e-8776-5020-9c00-7181115f7e65 with identifier: WX21157
2026-03-30 13:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7261993e-8776-5020-9c00-7181115f7e65 with scrape type 2
2026-03-30 13:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7261993e-8776-5020-9c00-7181115f7e65 with scrape type 2
2026-03-30 13:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7261993e-8776-5020-9c00-7181115f7e65, identifier: WX21157
2026-03-30 13:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7261993e-8776-5020-9c00-7181115f7e65 with identifier: WX21157
2026-03-30 13:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7261993e-8776-5020-9c00-7181115f7e65 with identifier: WX21157
2026-03-30 13:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7261993e-8776-5020-9c00-7181115f7e65 with identifier: WX21157 to the API
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:42:46Z',
'fuel_type': 'petrol',
'id': '7261993e-8776-5020-9c00-7181115f7e65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX21157',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 36325,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active Pack',
'transmission': 'manual',
'trim': 'Active Pack',
'year': 2022}
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX21157%27 HTTP/1.1" 200 None
2026-03-30 13:16:27 [auto1.fr] INFO: Saving data for WX21157: {'auction_closing_time': 1774885366.0, 'created_time': 1774015242.691703, 'last_price_update_time': 1774876587.669489}
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX21157') HTTP/1.1" 204 0
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 13:16:27 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV60309%27 HTTP/1.1" 200 None
2026-03-30 13:16:27 [auto1.fr] INFO: Scrape type for PV60309: 2
2026-03-30 13:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with identifier: PV60309
2026-03-30 13:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with scrape type 2
2026-03-30 13:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with scrape type 2
2026-03-30 13:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a8e0788-acd1-5cd8-ba24-62ecd98f8072, identifier: PV60309
2026-03-30 13:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with identifier: PV60309
2026-03-30 13:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with identifier: PV60309
2026-03-30 13:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a8e0788-acd1-5cd8-ba24-62ecd98f8072 with identifier: PV60309 to the API
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:06:19Z',
'fuel_type': 'diesel',
'id': '1a8e0788-acd1-5cd8-ba24-62ecd98f8072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV60309',
'listing': 'auction',
'make': 'Skoda',
'model': 'Scala',
'odometer': 163248,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seller_name': None,
'title': 'Skoda Scala 1.6 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2019}
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV60309%27 HTTP/1.1" 200 None
2026-03-30 13:16:28 [auto1.fr] INFO: Saving data for PV60309: {'auction_closing_time': 1774883179.0, 'created_time': 1772777649.313908, 'last_price_update_time': 1774876588.104685}
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV60309') HTTP/1.1" 204 0
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 13:16:28 [auto1.fr] INFO: Channel: 24h | Page: 142 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ74306%27 HTTP/1.1" 200 None
2026-03-30 13:16:28 [auto1.fr] INFO: Scrape type for HZ74306: 2
2026-03-30 13:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5633ea25-9aad-5300-aeee-64dbbef4d25c with identifier: HZ74306
2026-03-30 13:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5633ea25-9aad-5300-aeee-64dbbef4d25c with scrape type 2
2026-03-30 13:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5633ea25-9aad-5300-aeee-64dbbef4d25c with scrape type 2
2026-03-30 13:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5633ea25-9aad-5300-aeee-64dbbef4d25c, identifier: HZ74306
2026-03-30 13:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5633ea25-9aad-5300-aeee-64dbbef4d25c with identifier: HZ74306
2026-03-30 13:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5633ea25-9aad-5300-aeee-64dbbef4d25c with identifier: HZ74306
2026-03-30 13:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5633ea25-9aad-5300-aeee-64dbbef4d25c with identifier: HZ74306 to the API
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-30T15:56:59Z',
'fuel_type': 'petrol',
'id': '5633ea25-9aad-5300-aeee-64dbbef4d25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ74306',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 16911,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-25',
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Evolution',
'transmission': 'manual',
'trim': 'Evolution',
'year': 2024}
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ74306%27 HTTP/1.1" 200 None
2026-03-30 13:16:28 [auto1.fr] INFO: Saving data for HZ74306: {'auction_closing_time': 1774886219.0, 'created_time': 1774091978.949044, 'last_price_update_time': 1774876588.513466}
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HZ74306') HTTP/1.1" 204 0
2026-03-30 13:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 13:16:28 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC15476%27 HTTP/1.1" 200 None
2026-03-30 13:16:28 [auto1.fr] INFO: Scrape type for KC15476: 2
2026-03-30 13:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd90788f-231f-5c14-8f05-b266066d0805 with identifier: KC15476
2026-03-30 13:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd90788f-231f-5c14-8f05-b266066d0805 with scrape type 2
2026-03-30 13:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd90788f-231f-5c14-8f05-b266066d0805 with scrape type 2
2026-03-30 13:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd90788f-231f-5c14-8f05-b266066d0805, identifier: KC15476
2026-03-30 13:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd90788f-231f-5c14-8f05-b266066d0805 with identifier: KC15476
2026-03-30 13:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd90788f-231f-5c14-8f05-b266066d0805 with identifier: KC15476
2026-03-30 13:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd90788f-231f-5c14-8f05-b266066d0805 with identifier: KC15476 to the API
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:39:19Z',
'fuel_type': 'diesel',
'id': 'dd90788f-231f-5c14-8f05-b266066d0805',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC15476',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 179173,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-18',
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC15476%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Saving data for KC15476: {'auction_closing_time': 1774885159.0, 'created_time': 1774038793.807711, 'last_price_update_time': 1774876589.068735}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC15476') HTTP/1.1" 204 0
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA57472%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Scrape type for KA57472: 2
2026-03-30 13:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4168425a-3976-5c38-8027-b618eeaad760 with identifier: KA57472
2026-03-30 13:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4168425a-3976-5c38-8027-b618eeaad760 with scrape type 2
2026-03-30 13:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4168425a-3976-5c38-8027-b618eeaad760 with scrape type 2
2026-03-30 13:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4168425a-3976-5c38-8027-b618eeaad760, identifier: KA57472
2026-03-30 13:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4168425a-3976-5c38-8027-b618eeaad760 with identifier: KA57472
2026-03-30 13:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4168425a-3976-5c38-8027-b618eeaad760 with identifier: KA57472
2026-03-30 13:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4168425a-3976-5c38-8027-b618eeaad760 with identifier: KA57472 to the API
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:51:18Z',
'fuel_type': 'diesel',
'id': '4168425a-3976-5c38-8027-b618eeaad760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA57472',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 171752,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-07',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Sensation',
'transmission': 'manual',
'trim': 'Sensation',
'year': 2017}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA57472%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Saving data for KA57472: {'auction_closing_time': 1774885878.0, 'created_time': 1774696791.940733, 'last_price_update_time': 1774876589.47351}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA57472') HTTP/1.1" 204 0
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG08917%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Scrape type for BG08917: 2
2026-03-30 13:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c82acb-86b5-529e-93e0-d0a678f66e85 with identifier: BG08917
2026-03-30 13:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c82acb-86b5-529e-93e0-d0a678f66e85 with scrape type 2
2026-03-30 13:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2c82acb-86b5-529e-93e0-d0a678f66e85 with scrape type 2
2026-03-30 13:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d2c82acb-86b5-529e-93e0-d0a678f66e85, identifier: BG08917
2026-03-30 13:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d2c82acb-86b5-529e-93e0-d0a678f66e85 with identifier: BG08917
2026-03-30 13:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d2c82acb-86b5-529e-93e0-d0a678f66e85 with identifier: BG08917
2026-03-30 13:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d2c82acb-86b5-529e-93e0-d0a678f66e85 with identifier: BG08917 to the API
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:55:38Z',
'fuel_type': 'petrol',
'id': 'd2c82acb-86b5-529e-93e0-d0a678f66e85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG08917',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1994-04-26',
'seller_name': None,
'title': 'BMW 3er 325i',
'transmission': 'manual',
'trim': '',
'year': 1994}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG08917%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Saving data for BG08917: {'auction_closing_time': 1774886138.0, 'created_time': 1773348032.013768, 'last_price_update_time': 1774876589.865825}
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG08917') HTTP/1.1" 204 0
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 13:16:29 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC79698%27 HTTP/1.1" 200 None
2026-03-30 13:16:29 [auto1.fr] INFO: Scrape type for UC79698: 2
2026-03-30 13:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with identifier: UC79698
2026-03-30 13:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with scrape type 2
2026-03-30 13:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with scrape type 2
2026-03-30 13:16:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c, identifier: UC79698
2026-03-30 13:16:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with identifier: UC79698
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 13:16:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 13:16:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with identifier: UC79698
2026-03-30 13:16:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23702f76-cf98-53ee-b8c7-f9d09e1ffd1c with identifier: UC79698 to the API
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:06:54Z',
'fuel_type': 'petrol',
'id': '23702f76-cf98-53ee-b8c7-f9d09e1ffd1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC79698',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 104867,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-28',
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Pack 4x4',
'transmission': 'manual',
'trim': 'Pack 4x4',
'year': 2017}
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC79698%27 HTTP/1.1" 200 None
2026-03-30 13:16:30 [auto1.fr] INFO: Saving data for UC79698: {'auction_closing_time': 1774883214.0, 'created_time': 1774038788.6192589, 'last_price_update_time': 1774876590.50777}
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC79698') HTTP/1.1" 204 0
2026-03-30 13:16:30 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM38223%27 HTTP/1.1" 200 None
2026-03-30 13:16:30 [auto1.fr] INFO: Scrape type for GM38223: 2
2026-03-30 13:16:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5074e50f-e830-5abe-b964-b4ec6f040152 with identifier: GM38223
2026-03-30 13:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5074e50f-e830-5abe-b964-b4ec6f040152 with scrape type 2
2026-03-30 13:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5074e50f-e830-5abe-b964-b4ec6f040152 with scrape type 2
2026-03-30 13:16:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5074e50f-e830-5abe-b964-b4ec6f040152, identifier: GM38223
2026-03-30 13:16:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5074e50f-e830-5abe-b964-b4ec6f040152 with identifier: GM38223
2026-03-30 13:16:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5074e50f-e830-5abe-b964-b4ec6f040152 with identifier: GM38223
2026-03-30 13:16:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5074e50f-e830-5abe-b964-b4ec6f040152 with identifier: GM38223 to the API
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:51:31Z',
'fuel_type': 'petrol',
'id': '5074e50f-e830-5abe-b964-b4ec6f040152',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM38223',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3',
'odometer': 59899,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-24',
'seller_name': None,
'title': 'Citroen DS3 1.2 PureTech SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2016}
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM38223%27 HTTP/1.1" 200 None
2026-03-30 13:16:31 [auto1.fr] INFO: Saving data for GM38223: {'auction_closing_time': 1774885891.0, 'created_time': 1772734950.579789, 'last_price_update_time': 1774876591.022684}
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM38223') HTTP/1.1" 204 0
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA52322%27 HTTP/1.1" 200 None
2026-03-30 13:16:31 [auto1.fr] INFO: Scrape type for KA52322: 2
2026-03-30 13:16:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c1281f-b5da-5e91-bfe9-832bd70a34ef with identifier: KA52322
2026-03-30 13:16:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c1281f-b5da-5e91-bfe9-832bd70a34ef with scrape type 2
2026-03-30 13:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30c1281f-b5da-5e91-bfe9-832bd70a34ef with scrape type 2
2026-03-30 13:16:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 30c1281f-b5da-5e91-bfe9-832bd70a34ef, identifier: KA52322
2026-03-30 13:16:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 30c1281f-b5da-5e91-bfe9-832bd70a34ef with identifier: KA52322
2026-03-30 13:16:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 30c1281f-b5da-5e91-bfe9-832bd70a34ef with identifier: KA52322
2026-03-30 13:16:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 30c1281f-b5da-5e91-bfe9-832bd70a34ef with identifier: KA52322 to the API
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:46:28Z',
'fuel_type': 'petrol',
'id': '30c1281f-b5da-5e91-bfe9-832bd70a34ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA52322',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 181942,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-24',
'seller_name': None,
'title': 'Renault Clio 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2003}
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA52322%27 HTTP/1.1" 200 None
2026-03-30 13:16:31 [auto1.fr] INFO: Saving data for KA52322: {'auction_closing_time': 1774885588.0, 'created_time': 1772818633.34603, 'last_price_update_time': 1774876591.806877}
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA52322') HTTP/1.1" 204 0
2026-03-30 13:16:31 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD86266%27 HTTP/1.1" 200 None
2026-03-30 13:16:31 [auto1.fr] INFO: Scrape type for KD86266: 2
2026-03-30 13:16:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with identifier: KD86266
2026-03-30 13:16:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with scrape type 2
2026-03-30 13:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with scrape type 2
2026-03-30 13:16:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b153dbc-b13f-53a6-b9e0-4e401e14cd50, identifier: KD86266
2026-03-30 13:16:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with identifier: KD86266
2026-03-30 13:16:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with identifier: KD86266
2026-03-30 13:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b153dbc-b13f-53a6-b9e0-4e401e14cd50 with identifier: KD86266 to the API
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:31:53Z',
'fuel_type': 'diesel',
'id': '6b153dbc-b13f-53a6-b9e0-4e401e14cd50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD86266',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 98905,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-27',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
'transmission': 'manual',
'trim': 'Active L1',
'year': 2020}
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD86266%27 HTTP/1.1" 200 None
2026-03-30 13:16:32 [auto1.fr] INFO: Saving data for KD86266: {'auction_closing_time': 1774884713.0, 'created_time': 1774696799.346065, 'last_price_update_time': 1774876592.226342}
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD86266') HTTP/1.1" 204 0
2026-03-30 13:16:32 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 13:16:32 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 13:16:32 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 13:16:32 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ08369%27 HTTP/1.1" 200 None
2026-03-30 13:16:32 [auto1.fr] INFO: Scrape type for CJ08369: 2
2026-03-30 13:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d198cea-f4ca-54e2-8102-7b3afe911aef with identifier: CJ08369
2026-03-30 13:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d198cea-f4ca-54e2-8102-7b3afe911aef with scrape type 2
2026-03-30 13:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d198cea-f4ca-54e2-8102-7b3afe911aef with scrape type 2
2026-03-30 13:16:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d198cea-f4ca-54e2-8102-7b3afe911aef, identifier: CJ08369
2026-03-30 13:16:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d198cea-f4ca-54e2-8102-7b3afe911aef with identifier: CJ08369
2026-03-30 13:16:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d198cea-f4ca-54e2-8102-7b3afe911aef with identifier: CJ08369
2026-03-30 13:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9d198cea-f4ca-54e2-8102-7b3afe911aef with identifier: CJ08369 to the API
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:46:52Z',
'fuel_type': 'diesel',
'id': '9d198cea-f4ca-54e2-8102-7b3afe911aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ08369',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 109943,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-10',
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2007}
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ08369%27 HTTP/1.1" 200 None
2026-03-30 13:16:32 [auto1.fr] INFO: Saving data for CJ08369: {'auction_closing_time': 1774885612.0, 'created_time': 1774696838.336716, 'last_price_update_time': 1774876592.635819}
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ08369') HTTP/1.1" 204 0
2026-03-30 13:16:32 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE66506%27 HTTP/1.1" 200 None
2026-03-30 13:16:32 [auto1.fr] INFO: Scrape type for AE66506: 2
2026-03-30 13:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd0bc9fa-a4b7-5856-a776-8172c5b55bea with identifier: AE66506
2026-03-30 13:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd0bc9fa-a4b7-5856-a776-8172c5b55bea with scrape type 2
2026-03-30 13:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd0bc9fa-a4b7-5856-a776-8172c5b55bea with scrape type 2
2026-03-30 13:16:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd0bc9fa-a4b7-5856-a776-8172c5b55bea, identifier: AE66506
2026-03-30 13:16:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd0bc9fa-a4b7-5856-a776-8172c5b55bea with identifier: AE66506
2026-03-30 13:16:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd0bc9fa-a4b7-5856-a776-8172c5b55bea with identifier: AE66506
2026-03-30 13:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd0bc9fa-a4b7-5856-a776-8172c5b55bea with identifier: AE66506 to the API
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:03:09Z',
'fuel_type': 'diesel',
'id': 'dd0bc9fa-a4b7-5856-a776-8172c5b55bea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE66506',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 55017,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-25',
'seller_name': None,
'title': 'Peugeot Expert 1.5 Blue-HDi Premium L1',
'transmission': 'manual',
'trim': 'Premium L1',
'year': 2020}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE66506%27 HTTP/1.1" 200 None
2026-03-30 13:16:33 [auto1.fr] INFO: Saving data for AE66506: {'auction_closing_time': 1774882989.0, 'created_time': 1774015239.498965, 'last_price_update_time': 1774876593.115189}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE66506') HTTP/1.1" 204 0
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE59820%27 HTTP/1.1" 200 None
2026-03-30 13:16:33 [auto1.fr] INFO: Scrape type for XE59820: 2
2026-03-30 13:16:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac6abed8-91bf-5046-9249-1a65175fd9b6 with identifier: XE59820
2026-03-30 13:16:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac6abed8-91bf-5046-9249-1a65175fd9b6 with scrape type 2
2026-03-30 13:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac6abed8-91bf-5046-9249-1a65175fd9b6 with scrape type 2
2026-03-30 13:16:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ac6abed8-91bf-5046-9249-1a65175fd9b6, identifier: XE59820
2026-03-30 13:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ac6abed8-91bf-5046-9249-1a65175fd9b6 with identifier: XE59820
2026-03-30 13:16:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ac6abed8-91bf-5046-9249-1a65175fd9b6 with identifier: XE59820
2026-03-30 13:16:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ac6abed8-91bf-5046-9249-1a65175fd9b6 with identifier: XE59820 to the API
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:52Z',
'fuel_type': 'diesel',
'id': 'ac6abed8-91bf-5046-9249-1a65175fd9b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE59820',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 160835,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-22',
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Td4 Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2013}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE59820%27 HTTP/1.1" 200 None
2026-03-30 13:16:33 [auto1.fr] INFO: Saving data for XE59820: {'auction_closing_time': 1774884052.0, 'created_time': 1773335804.778793, 'last_price_update_time': 1774876593.513334}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XE59820') HTTP/1.1" 204 0
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 13:16:33 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW87984%27 HTTP/1.1" 200 None
2026-03-30 13:16:33 [auto1.fr] INFO: Scrape type for SW87984: 2
2026-03-30 13:16:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with identifier: SW87984
2026-03-30 13:16:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with scrape type 2
2026-03-30 13:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with scrape type 2
2026-03-30 13:16:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3b78c7f-1a02-5b8a-9b25-d486d2c41431, identifier: SW87984
2026-03-30 13:16:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with identifier: SW87984
2026-03-30 13:16:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with identifier: SW87984
2026-03-30 13:16:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3b78c7f-1a02-5b8a-9b25-d486d2c41431 with identifier: SW87984 to the API
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:33:22Z',
'fuel_type': 'petrol',
'id': 'b3b78c7f-1a02-5b8a-9b25-d486d2c41431',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW87984',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 126936,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Peugeot 2008 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW87984%27 HTTP/1.1" 200 None
2026-03-30 13:16:33 [auto1.fr] INFO: Saving data for SW87984: {'auction_closing_time': 1774884802.0, 'created_time': 1774696798.443204, 'last_price_update_time': 1774876593.87459}
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW87984') HTTP/1.1" 204 0
2026-03-30 13:16:33 [auto1.fr] INFO: Channel: 24h | Page: 143 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM52767%27 HTTP/1.1" 200 None
2026-03-30 13:16:34 [auto1.fr] INFO: Scrape type for FM52767: 2
2026-03-30 13:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ec17efc-7978-534f-a94c-33a1a4bce55e with identifier: FM52767
2026-03-30 13:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec17efc-7978-534f-a94c-33a1a4bce55e with scrape type 2
2026-03-30 13:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ec17efc-7978-534f-a94c-33a1a4bce55e with scrape type 2
2026-03-30 13:16:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ec17efc-7978-534f-a94c-33a1a4bce55e, identifier: FM52767
2026-03-30 13:16:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ec17efc-7978-534f-a94c-33a1a4bce55e with identifier: FM52767
2026-03-30 13:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ec17efc-7978-534f-a94c-33a1a4bce55e with identifier: FM52767
2026-03-30 13:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5ec17efc-7978-534f-a94c-33a1a4bce55e with identifier: FM52767 to the API
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 173,
'expiration_date': '2026-03-30T15:05:14Z',
'fuel_type': 'diesel',
'id': '5ec17efc-7978-534f-a94c-33a1a4bce55e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM52767',
'listing': 'auction',
'make': 'Renault',
'model': 'Laguna',
'odometer': 116783,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-05',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Monaco GP',
'transmission': 'manual',
'trim': 'Monaco GP',
'year': 2013}
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM52767%27 HTTP/1.1" 200 None
2026-03-30 13:16:34 [auto1.fr] INFO: Saving data for FM52767: {'auction_closing_time': 1774883114.0, 'created_time': 1774696833.646527, 'last_price_update_time': 1774876594.490624}
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM52767') HTTP/1.1" 204 0
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV92457%27 HTTP/1.1" 200 None
2026-03-30 13:16:34 [auto1.fr] INFO: Scrape type for SV92457: 2
2026-03-30 13:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56fa4846-73f8-5e88-937e-100887d111e1 with identifier: SV92457
2026-03-30 13:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56fa4846-73f8-5e88-937e-100887d111e1 with scrape type 2
2026-03-30 13:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56fa4846-73f8-5e88-937e-100887d111e1 with scrape type 2
2026-03-30 13:16:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56fa4846-73f8-5e88-937e-100887d111e1, identifier: SV92457
2026-03-30 13:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56fa4846-73f8-5e88-937e-100887d111e1 with identifier: SV92457
2026-03-30 13:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56fa4846-73f8-5e88-937e-100887d111e1 with identifier: SV92457
2026-03-30 13:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56fa4846-73f8-5e88-937e-100887d111e1 with identifier: SV92457 to the API
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-30T15:01:38Z',
'fuel_type': 'diesel',
'id': '56fa4846-73f8-5e88-937e-100887d111e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV92457',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 45439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-31',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2014}
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV92457%27 HTTP/1.1" 200 None
2026-03-30 13:16:34 [auto1.fr] INFO: Saving data for SV92457: {'auction_closing_time': 1774882898.0, 'created_time': 1774696803.856277, 'last_price_update_time': 1774876594.882442}
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV92457') HTTP/1.1" 204 0
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 13:16:34 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE23710%27 HTTP/1.1" 200 None
2026-03-30 13:16:34 [auto1.fr] INFO: Scrape type for TE23710: 2
2026-03-30 13:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a0acbe-7c05-5220-a269-e270278bc905 with identifier: TE23710
2026-03-30 13:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a0acbe-7c05-5220-a269-e270278bc905 with scrape type 2
2026-03-30 13:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a0acbe-7c05-5220-a269-e270278bc905 with scrape type 2
2026-03-30 13:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08a0acbe-7c05-5220-a269-e270278bc905, identifier: TE23710
2026-03-30 13:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08a0acbe-7c05-5220-a269-e270278bc905 with identifier: TE23710
2026-03-30 13:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08a0acbe-7c05-5220-a269-e270278bc905 with identifier: TE23710
2026-03-30 13:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08a0acbe-7c05-5220-a269-e270278bc905 with identifier: TE23710 to the API
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:28:54Z',
'fuel_type': 'petrol',
'id': '08a0acbe-7c05-5220-a269-e270278bc905',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE23710',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 128576,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Peugeot 308 1.6 THP GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2015}
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE23710%27 HTTP/1.1" 200 None
2026-03-30 13:16:35 [auto1.fr] INFO: Saving data for TE23710: {'auction_closing_time': 1774884534.0, 'created_time': 1774696864.365915, 'last_price_update_time': 1774876595.295831}
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE23710') HTTP/1.1" 204 0
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW13356%27 HTTP/1.1" 200 None
2026-03-30 13:16:35 [auto1.fr] INFO: Scrape type for XW13356: 2
2026-03-30 13:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a10eea-f3ed-5013-bb94-e8d624446091 with identifier: XW13356
2026-03-30 13:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a10eea-f3ed-5013-bb94-e8d624446091 with scrape type 2
2026-03-30 13:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35a10eea-f3ed-5013-bb94-e8d624446091 with scrape type 2
2026-03-30 13:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35a10eea-f3ed-5013-bb94-e8d624446091, identifier: XW13356
2026-03-30 13:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35a10eea-f3ed-5013-bb94-e8d624446091 with identifier: XW13356
2026-03-30 13:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35a10eea-f3ed-5013-bb94-e8d624446091 with identifier: XW13356
2026-03-30 13:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35a10eea-f3ed-5013-bb94-e8d624446091 with identifier: XW13356 to the API
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:44:11Z',
'fuel_type': 'petrol',
'id': '35a10eea-f3ed-5013-bb94-e8d624446091',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW13356',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 154316,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-05',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW13356%27 HTTP/1.1" 200 None
2026-03-30 13:16:35 [auto1.fr] INFO: Saving data for XW13356: {'auction_closing_time': 1774885451.0, 'created_time': 1774696883.178995, 'last_price_update_time': 1774876595.766353}
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XW13356') HTTP/1.1" 204 0
2026-03-30 13:16:35 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU86127%27 HTTP/1.1" 200 None
2026-03-30 13:16:35 [auto1.fr] INFO: Scrape type for HU86127: 2
2026-03-30 13:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a972022c-953a-5bf3-80bf-1da67dcbe82a with identifier: HU86127
2026-03-30 13:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a972022c-953a-5bf3-80bf-1da67dcbe82a with scrape type 2
2026-03-30 13:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a972022c-953a-5bf3-80bf-1da67dcbe82a with scrape type 2
2026-03-30 13:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a972022c-953a-5bf3-80bf-1da67dcbe82a, identifier: HU86127
2026-03-30 13:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a972022c-953a-5bf3-80bf-1da67dcbe82a with identifier: HU86127
2026-03-30 13:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a972022c-953a-5bf3-80bf-1da67dcbe82a with identifier: HU86127
2026-03-30 13:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a972022c-953a-5bf3-80bf-1da67dcbe82a with identifier: HU86127 to the API
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:29Z',
'fuel_type': 'diesel',
'id': 'a972022c-953a-5bf3-80bf-1da67dcbe82a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU86127',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 247523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-14',
'seller_name': None,
'title': 'Mitsubishi ASX 1.8 DI-D Motion 2WD',
'transmission': 'manual',
'trim': 'Motion 2WD',
'year': 2011}
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU86127%27 HTTP/1.1" 200 None
2026-03-30 13:16:36 [auto1.fr] INFO: Saving data for HU86127: {'auction_closing_time': 1774883729.0, 'created_time': 1774696834.183265, 'last_price_update_time': 1774876596.216355}
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HU86127') HTTP/1.1" 204 0
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH02175%27 HTTP/1.1" 200 None
2026-03-30 13:16:36 [auto1.fr] INFO: Scrape type for YH02175: 2
2026-03-30 13:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f69816-7801-58d0-95c7-42a8f74febe0 with identifier: YH02175
2026-03-30 13:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f69816-7801-58d0-95c7-42a8f74febe0 with scrape type 2
2026-03-30 13:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f69816-7801-58d0-95c7-42a8f74febe0 with scrape type 2
2026-03-30 13:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 34f69816-7801-58d0-95c7-42a8f74febe0, identifier: YH02175
2026-03-30 13:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 34f69816-7801-58d0-95c7-42a8f74febe0 with identifier: YH02175
2026-03-30 13:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 34f69816-7801-58d0-95c7-42a8f74febe0 with identifier: YH02175
2026-03-30 13:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 34f69816-7801-58d0-95c7-42a8f74febe0 with identifier: YH02175 to the API
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:13Z',
'fuel_type': 'diesel',
'id': '34f69816-7801-58d0-95c7-42a8f74febe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH02175',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 286498,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-25',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH02175%27 HTTP/1.1" 200 None
2026-03-30 13:16:36 [auto1.fr] INFO: Saving data for YH02175: {'auction_closing_time': 1774883473.0, 'created_time': 1772735453.718373, 'last_price_update_time': 1774876596.639271}
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH02175') HTTP/1.1" 204 0
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 13:16:36 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH02348%27 HTTP/1.1" 200 None
2026-03-30 13:16:36 [auto1.fr] INFO: Scrape type for FH02348: 2
2026-03-30 13:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14052c75-2d99-529c-8a81-7a9e48cb56ad with identifier: FH02348
2026-03-30 13:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14052c75-2d99-529c-8a81-7a9e48cb56ad with scrape type 2
2026-03-30 13:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14052c75-2d99-529c-8a81-7a9e48cb56ad with scrape type 2
2026-03-30 13:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14052c75-2d99-529c-8a81-7a9e48cb56ad, identifier: FH02348
2026-03-30 13:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14052c75-2d99-529c-8a81-7a9e48cb56ad with identifier: FH02348
2026-03-30 13:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14052c75-2d99-529c-8a81-7a9e48cb56ad with identifier: FH02348
2026-03-30 13:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14052c75-2d99-529c-8a81-7a9e48cb56ad with identifier: FH02348 to the API
2026-03-30 13:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:04:44Z',
'fuel_type': 'diesel',
'id': '14052c75-2d99-529c-8a81-7a9e48cb56ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH02348',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 317106,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-30',
'seller_name': None,
'title': 'Honda Civic 2.2 CTDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-30 13:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH02348%27 HTTP/1.1" 200 None
2026-03-30 13:16:37 [auto1.fr] INFO: Saving data for FH02348: {'auction_closing_time': 1774883084.0, 'created_time': 1774696854.851709, 'last_price_update_time': 1774876597.16161}
2026-03-30 13:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH02348') HTTP/1.1" 204 0
2026-03-30 13:16:37 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 13:16:37 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 13:16:37 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 13:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:38 [auto1.fr] INFO: Channel: 24h | Page: 144 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE53888%27 HTTP/1.1" 200 None
2026-03-30 13:16:38 [auto1.fr] INFO: Scrape type for CE53888: 2
2026-03-30 13:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 323e3fb8-370f-541f-beb7-e2d5f38e73cc with identifier: CE53888
2026-03-30 13:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 323e3fb8-370f-541f-beb7-e2d5f38e73cc with scrape type 2
2026-03-30 13:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 323e3fb8-370f-541f-beb7-e2d5f38e73cc with scrape type 2
2026-03-30 13:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 323e3fb8-370f-541f-beb7-e2d5f38e73cc, identifier: CE53888
2026-03-30 13:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 323e3fb8-370f-541f-beb7-e2d5f38e73cc with identifier: CE53888
2026-03-30 13:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 323e3fb8-370f-541f-beb7-e2d5f38e73cc with identifier: CE53888
2026-03-30 13:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 323e3fb8-370f-541f-beb7-e2d5f38e73cc with identifier: CE53888 to the API
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:44:31Z',
'fuel_type': 'diesel',
'id': '323e3fb8-370f-541f-beb7-e2d5f38e73cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE53888',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 154870,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-24',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE53888%27 HTTP/1.1" 200 None
2026-03-30 13:16:38 [auto1.fr] INFO: Saving data for CE53888: {'auction_closing_time': 1774885471.0, 'created_time': 1773433639.523707, 'last_price_update_time': 1774876598.52679}
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE53888') HTTP/1.1" 204 0
2026-03-30 13:16:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 13:16:38 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE40848%27 HTTP/1.1" 200 None
2026-03-30 13:16:38 [auto1.fr] INFO: Scrape type for NE40848: 2
2026-03-30 13:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea598ff-af88-534a-a7e2-77365651fcd6 with identifier: NE40848
2026-03-30 13:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea598ff-af88-534a-a7e2-77365651fcd6 with scrape type 2
2026-03-30 13:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea598ff-af88-534a-a7e2-77365651fcd6 with scrape type 2
2026-03-30 13:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ea598ff-af88-534a-a7e2-77365651fcd6, identifier: NE40848
2026-03-30 13:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ea598ff-af88-534a-a7e2-77365651fcd6 with identifier: NE40848
2026-03-30 13:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ea598ff-af88-534a-a7e2-77365651fcd6 with identifier: NE40848
2026-03-30 13:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ea598ff-af88-534a-a7e2-77365651fcd6 with identifier: NE40848 to the API
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:12:57Z',
'fuel_type': 'diesel',
'id': '7ea598ff-af88-534a-a7e2-77365651fcd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE40848',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 219688,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-28',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE40848%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Saving data for NE40848: {'auction_closing_time': 1774883577.0, 'created_time': 1774696853.675873, 'last_price_update_time': 1774876599.057383}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE40848') HTTP/1.1" 204 0
2026-03-30 13:16:39 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV78371%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Scrape type for GV78371: 2
2026-03-30 13:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 117abd42-cd86-53af-b6d1-31bac1a7221e with identifier: GV78371
2026-03-30 13:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 117abd42-cd86-53af-b6d1-31bac1a7221e with scrape type 2
2026-03-30 13:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 117abd42-cd86-53af-b6d1-31bac1a7221e with scrape type 2
2026-03-30 13:16:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 117abd42-cd86-53af-b6d1-31bac1a7221e, identifier: GV78371
2026-03-30 13:16:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 117abd42-cd86-53af-b6d1-31bac1a7221e with identifier: GV78371
2026-03-30 13:16:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 117abd42-cd86-53af-b6d1-31bac1a7221e with identifier: GV78371
2026-03-30 13:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 117abd42-cd86-53af-b6d1-31bac1a7221e with identifier: GV78371 to the API
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-30T15:29:03Z',
'fuel_type': 'petrol',
'id': '117abd42-cd86-53af-b6d1-31bac1a7221e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV78371',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 27109,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV78371%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Saving data for GV78371: {'auction_closing_time': 1774884543.0, 'created_time': 1774124410.59898, 'last_price_update_time': 1774876599.457833}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV78371') HTTP/1.1" 204 0
2026-03-30 13:16:39 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK73367%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Scrape type for HK73367: 2
2026-03-30 13:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3491e03-4bb2-5b43-913f-055dcf8f8b4d with identifier: HK73367
2026-03-30 13:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3491e03-4bb2-5b43-913f-055dcf8f8b4d with scrape type 2
2026-03-30 13:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3491e03-4bb2-5b43-913f-055dcf8f8b4d with scrape type 2
2026-03-30 13:16:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3491e03-4bb2-5b43-913f-055dcf8f8b4d, identifier: HK73367
2026-03-30 13:16:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3491e03-4bb2-5b43-913f-055dcf8f8b4d with identifier: HK73367
2026-03-30 13:16:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3491e03-4bb2-5b43-913f-055dcf8f8b4d with identifier: HK73367
2026-03-30 13:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3491e03-4bb2-5b43-913f-055dcf8f8b4d with identifier: HK73367 to the API
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:09:23Z',
'fuel_type': 'petrol',
'id': 'a3491e03-4bb2-5b43-913f-055dcf8f8b4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK73367',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 200834,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-04',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK73367%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Saving data for HK73367: {'auction_closing_time': 1774883363.0, 'created_time': 1774015145.816015, 'last_price_update_time': 1774876599.87103}
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK73367') HTTP/1.1" 204 0
2026-03-30 13:16:39 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 13:16:39 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR44134%27 HTTP/1.1" 200 None
2026-03-30 13:16:39 [auto1.fr] INFO: Scrape type for SR44134: 2
2026-03-30 13:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7742379-b04a-5eef-9a62-5d91f3d1f82f with identifier: SR44134
2026-03-30 13:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7742379-b04a-5eef-9a62-5d91f3d1f82f with scrape type 2
2026-03-30 13:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7742379-b04a-5eef-9a62-5d91f3d1f82f with scrape type 2
2026-03-30 13:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7742379-b04a-5eef-9a62-5d91f3d1f82f, identifier: SR44134
2026-03-30 13:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7742379-b04a-5eef-9a62-5d91f3d1f82f with identifier: SR44134
2026-03-30 13:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7742379-b04a-5eef-9a62-5d91f3d1f82f with identifier: SR44134
2026-03-30 13:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7742379-b04a-5eef-9a62-5d91f3d1f82f with identifier: SR44134 to the API
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:57:30Z',
'fuel_type': 'diesel',
'id': 'b7742379-b04a-5eef-9a62-5d91f3d1f82f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR44134',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 173887,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-02',
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR44134%27 HTTP/1.1" 200 None
2026-03-30 13:16:40 [auto1.fr] INFO: Saving data for SR44134: {'auction_closing_time': 1774886250.0, 'created_time': 1774696832.182863, 'last_price_update_time': 1774876600.292191}
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR44134') HTTP/1.1" 204 0
2026-03-30 13:16:40 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 13:16:40 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 13:16:40 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG76127%27 HTTP/1.1" 200 None
2026-03-30 13:16:40 [auto1.fr] INFO: Scrape type for JG76127: 2
2026-03-30 13:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a17040b-c1a0-5a27-8555-e9321773301a with identifier: JG76127
2026-03-30 13:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a17040b-c1a0-5a27-8555-e9321773301a with scrape type 2
2026-03-30 13:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a17040b-c1a0-5a27-8555-e9321773301a with scrape type 2
2026-03-30 13:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a17040b-c1a0-5a27-8555-e9321773301a, identifier: JG76127
2026-03-30 13:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a17040b-c1a0-5a27-8555-e9321773301a with identifier: JG76127
2026-03-30 13:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a17040b-c1a0-5a27-8555-e9321773301a with identifier: JG76127
2026-03-30 13:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a17040b-c1a0-5a27-8555-e9321773301a with identifier: JG76127 to the API
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:30:40Z',
'fuel_type': 'diesel',
'id': '1a17040b-c1a0-5a27-8555-e9321773301a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG76127',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 197847,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG76127%27 HTTP/1.1" 200 None
2026-03-30 13:16:40 [auto1.fr] INFO: Saving data for JG76127: {'auction_closing_time': 1774884640.0, 'created_time': 1774696866.620484, 'last_price_update_time': 1774876600.695482}
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG76127') HTTP/1.1" 204 0
2026-03-30 13:16:40 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW50914%27 HTTP/1.1" 200 None
2026-03-30 13:16:40 [auto1.fr] INFO: Scrape type for DW50914: 2
2026-03-30 13:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4879c50d-bc90-5064-856b-bc8ff8deb355 with identifier: DW50914
2026-03-30 13:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4879c50d-bc90-5064-856b-bc8ff8deb355 with scrape type 2
2026-03-30 13:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4879c50d-bc90-5064-856b-bc8ff8deb355 with scrape type 2
2026-03-30 13:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4879c50d-bc90-5064-856b-bc8ff8deb355, identifier: DW50914
2026-03-30 13:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4879c50d-bc90-5064-856b-bc8ff8deb355 with identifier: DW50914
2026-03-30 13:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4879c50d-bc90-5064-856b-bc8ff8deb355 with identifier: DW50914
2026-03-30 13:16:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4879c50d-bc90-5064-856b-bc8ff8deb355 with identifier: DW50914 to the API
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:23:08Z',
'fuel_type': 'petrol',
'id': '4879c50d-bc90-5064-856b-bc8ff8deb355',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW50914',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 94455,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2020}
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW50914%27 HTTP/1.1" 200 None
2026-03-30 13:16:41 [auto1.fr] INFO: Saving data for DW50914: {'auction_closing_time': 1774884188.0, 'created_time': 1774696855.651435, 'last_price_update_time': 1774876601.356883}
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW50914') HTTP/1.1" 204 0
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX77985%27 HTTP/1.1" 200 None
2026-03-30 13:16:41 [auto1.fr] INFO: Scrape type for NX77985: 0
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB84611%27 HTTP/1.1" 200 None
2026-03-30 13:16:41 [auto1.fr] INFO: Scrape type for MB84611: 2
2026-03-30 13:16:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c429fea9-15f8-5b32-809a-eebee6101c87 with identifier: MB84611
2026-03-30 13:16:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c429fea9-15f8-5b32-809a-eebee6101c87 with scrape type 2
2026-03-30 13:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c429fea9-15f8-5b32-809a-eebee6101c87 with scrape type 2
2026-03-30 13:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c429fea9-15f8-5b32-809a-eebee6101c87, identifier: MB84611
2026-03-30 13:16:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c429fea9-15f8-5b32-809a-eebee6101c87 with identifier: MB84611
2026-03-30 13:16:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c429fea9-15f8-5b32-809a-eebee6101c87 with identifier: MB84611
2026-03-30 13:16:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c429fea9-15f8-5b32-809a-eebee6101c87 with identifier: MB84611 to the API
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:13:32Z',
'fuel_type': 'diesel',
'id': 'c429fea9-15f8-5b32-809a-eebee6101c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB84611',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 222237,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-10',
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Confort Pack',
'transmission': 'manual',
'trim': 'Confort Pack',
'year': 2011}
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB84611%27 HTTP/1.1" 200 None
2026-03-30 13:16:41 [auto1.fr] INFO: Saving data for MB84611: {'auction_closing_time': 1774883612.0, 'created_time': 1774091896.896317, 'last_price_update_time': 1774876601.767384}
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB84611') HTTP/1.1" 204 0
2026-03-30 13:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 13:16:41 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA97847%27 HTTP/1.1" 200 None
2026-03-30 13:16:41 [auto1.fr] INFO: Scrape type for JA97847: 2
2026-03-30 13:16:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fbff44-611c-5b9c-b253-53a2523953f7 with identifier: JA97847
2026-03-30 13:16:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fbff44-611c-5b9c-b253-53a2523953f7 with scrape type 2
2026-03-30 13:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40fbff44-611c-5b9c-b253-53a2523953f7 with scrape type 2
2026-03-30 13:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40fbff44-611c-5b9c-b253-53a2523953f7, identifier: JA97847
2026-03-30 13:16:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40fbff44-611c-5b9c-b253-53a2523953f7 with identifier: JA97847
2026-03-30 13:16:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40fbff44-611c-5b9c-b253-53a2523953f7 with identifier: JA97847
2026-03-30 13:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40fbff44-611c-5b9c-b253-53a2523953f7 with identifier: JA97847 to the API
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:24:12Z',
'fuel_type': 'petrol',
'id': '40fbff44-611c-5b9c-b253-53a2523953f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA97847',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 151632,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-06',
'seller_name': None,
'title': 'Renault Clio 1.2 Extrême Claire',
'transmission': 'manual',
'trim': 'Extrême Claire',
'year': 2008}
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA97847%27 HTTP/1.1" 200 None
2026-03-30 13:16:42 [auto1.fr] INFO: Saving data for JA97847: {'auction_closing_time': 1774884252.0, 'created_time': 1774696873.57902, 'last_price_update_time': 1774876602.181262}
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA97847') HTTP/1.1" 204 0
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25172%27 HTTP/1.1" 200 None
2026-03-30 13:16:42 [auto1.fr] INFO: Scrape type for HD25172: 2
2026-03-30 13:16:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-03-30 13:16:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with scrape type 2
2026-03-30 13:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with scrape type 2
2026-03-30 13:16:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2abcd60b-a3f0-5ad6-b576-f62bdab94027, identifier: HD25172
2026-03-30 13:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-03-30 13:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-03-30 13:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172 to the API
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:35:58Z',
'fuel_type': 'petrol',
'id': '2abcd60b-a3f0-5ad6-b576-f62bdab94027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD25172',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 47808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-26',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25172%27 HTTP/1.1" 200 None
2026-03-30 13:16:42 [auto1.fr] INFO: Saving data for HD25172: {'auction_closing_time': 1774884958.0, 'created_time': 1774015564.249086, 'last_price_update_time': 1774876602.671425}
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD25172') HTTP/1.1" 204 0
2026-03-30 13:16:42 [auto1.fr] INFO: Channel: 24h | Page: 145 | totalHits: 5996 | hits on page: 40
2026-03-30 13:16:42 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY04507%27 HTTP/1.1" 200 None
2026-03-30 13:16:42 [auto1.fr] INFO: Scrape type for AY04507: 2
2026-03-30 13:16:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e530c0b0-9fb8-5f99-a559-2edcb37a0304 with identifier: AY04507
2026-03-30 13:16:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e530c0b0-9fb8-5f99-a559-2edcb37a0304 with scrape type 2
2026-03-30 13:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e530c0b0-9fb8-5f99-a559-2edcb37a0304 with scrape type 2
2026-03-30 13:16:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e530c0b0-9fb8-5f99-a559-2edcb37a0304, identifier: AY04507
2026-03-30 13:16:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e530c0b0-9fb8-5f99-a559-2edcb37a0304 with identifier: AY04507
2026-03-30 13:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e530c0b0-9fb8-5f99-a559-2edcb37a0304 with identifier: AY04507
2026-03-30 13:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e530c0b0-9fb8-5f99-a559-2edcb37a0304 with identifier: AY04507 to the API
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-30T15:28:07Z',
'fuel_type': 'hybrid',
'id': 'e530c0b0-9fb8-5f99-a559-2edcb37a0304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY04507',
'listing': 'auction',
'make': 'Kia',
'model': 'Niro',
'odometer': 183629,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-08',
'seller_name': None,
'title': 'Kia Niro 1.6 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2017}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY04507%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Saving data for AY04507: {'auction_closing_time': 1774884487.0, 'created_time': 1772731033.724252, 'last_price_update_time': 1774876603.059892}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY04507') HTTP/1.1" 204 0
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR62966%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Scrape type for YR62966: 2
2026-03-30 13:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with identifier: YR62966
2026-03-30 13:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba, identifier: YR62966
2026-03-30 13:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with identifier: YR62966
2026-03-30 13:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with identifier: YR62966
2026-03-30 13:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e711dea-a0d8-5e0b-bec4-a8802dcf1aba with identifier: YR62966 to the API
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:12Z',
'fuel_type': 'diesel',
'id': '0e711dea-a0d8-5e0b-bec4-a8802dcf1aba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR62966',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 237925,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-10',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Exclusive-Line',
'transmission': 'automatic',
'trim': 'Exclusive-Line',
'year': 2015}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR62966%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Saving data for YR62966: {'auction_closing_time': 1774885512.0, 'created_time': 1774696875.850539, 'last_price_update_time': 1774876603.475127}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR62966') HTTP/1.1" 204 0
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX07099%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Scrape type for TX07099: 2
2026-03-30 13:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c66253-bd5e-5640-843c-f03364f9560a with identifier: TX07099
2026-03-30 13:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c66253-bd5e-5640-843c-f03364f9560a with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c66253-bd5e-5640-843c-f03364f9560a with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58c66253-bd5e-5640-843c-f03364f9560a, identifier: TX07099
2026-03-30 13:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58c66253-bd5e-5640-843c-f03364f9560a with identifier: TX07099
2026-03-30 13:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58c66253-bd5e-5640-843c-f03364f9560a with identifier: TX07099
2026-03-30 13:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58c66253-bd5e-5640-843c-f03364f9560a with identifier: TX07099 to the API
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:09:19Z',
'fuel_type': 'petrol',
'id': '58c66253-bd5e-5640-843c-f03364f9560a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX07099',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 76658,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-30',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Crossway',
'transmission': 'manual',
'trim': 'Crossway',
'year': 2016}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX07099%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Saving data for TX07099: {'auction_closing_time': 1774883359.0, 'created_time': 1774696876.647724, 'last_price_update_time': 1774876603.856314}
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX07099') HTTP/1.1" 204 0
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 13:16:43 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR12452%27 HTTP/1.1" 200 None
2026-03-30 13:16:43 [auto1.fr] INFO: Scrape type for NR12452: 2
2026-03-30 13:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663835f1-f40b-51fb-9d47-ccab21de4866 with identifier: NR12452
2026-03-30 13:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663835f1-f40b-51fb-9d47-ccab21de4866 with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 663835f1-f40b-51fb-9d47-ccab21de4866 with scrape type 2
2026-03-30 13:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 663835f1-f40b-51fb-9d47-ccab21de4866, identifier: NR12452
2026-03-30 13:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 663835f1-f40b-51fb-9d47-ccab21de4866 with identifier: NR12452
2026-03-30 13:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 663835f1-f40b-51fb-9d47-ccab21de4866 with identifier: NR12452
2026-03-30 13:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 663835f1-f40b-51fb-9d47-ccab21de4866 with identifier: NR12452 to the API
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:22:28Z',
'fuel_type': 'gas',
'id': '663835f1-f40b-51fb-9d47-ccab21de4866',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR12452',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 40886,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Prestige +',
'transmission': 'manual',
'trim': 'Prestige +',
'year': 2021}
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR12452%27 HTTP/1.1" 200 None
2026-03-30 13:16:44 [auto1.fr] INFO: Saving data for NR12452: {'auction_closing_time': 1774884148.0, 'created_time': 1774696897.253573, 'last_price_update_time': 1774876604.257137}
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NR12452') HTTP/1.1" 204 0
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 13:16:44 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG44047%27 HTTP/1.1" 200 None
2026-03-30 13:16:44 [auto1.fr] INFO: Scrape type for HG44047: 2
2026-03-30 13:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a857a23-e656-57ac-b319-f5d11cfe37c9 with identifier: HG44047
2026-03-30 13:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a857a23-e656-57ac-b319-f5d11cfe37c9 with scrape type 2
2026-03-30 13:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a857a23-e656-57ac-b319-f5d11cfe37c9 with scrape type 2
2026-03-30 13:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a857a23-e656-57ac-b319-f5d11cfe37c9, identifier: HG44047
2026-03-30 13:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a857a23-e656-57ac-b319-f5d11cfe37c9 with identifier: HG44047
2026-03-30 13:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a857a23-e656-57ac-b319-f5d11cfe37c9 with identifier: HG44047
2026-03-30 13:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a857a23-e656-57ac-b319-f5d11cfe37c9 with identifier: HG44047 to the API
2026-03-30 13:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:47:24Z',
'fuel_type': 'petrol',
'id': '0a857a23-e656-57ac-b319-f5d11cfe37c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG44047',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 154341,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-10',
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG44047%27 HTTP/1.1" 200 None
2026-03-30 13:16:45 [auto1.fr] INFO: Saving data for HG44047: {'auction_closing_time': 1774885644.0, 'created_time': 1774696883.73841, 'last_price_update_time': 1774876605.534469}
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HG44047') HTTP/1.1" 204 0
2026-03-30 13:16:45 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 13:16:45 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ10967%27 HTTP/1.1" 200 None
2026-03-30 13:16:45 [auto1.fr] INFO: Scrape type for HZ10967: 2
2026-03-30 13:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1499872-898d-5e91-9925-3deb07d833c0 with identifier: HZ10967
2026-03-30 13:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1499872-898d-5e91-9925-3deb07d833c0 with scrape type 2
2026-03-30 13:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1499872-898d-5e91-9925-3deb07d833c0 with scrape type 2
2026-03-30 13:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1499872-898d-5e91-9925-3deb07d833c0, identifier: HZ10967
2026-03-30 13:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1499872-898d-5e91-9925-3deb07d833c0 with identifier: HZ10967
2026-03-30 13:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1499872-898d-5e91-9925-3deb07d833c0 with identifier: HZ10967
2026-03-30 13:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1499872-898d-5e91-9925-3deb07d833c0 with identifier: HZ10967 to the API
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:55:32Z',
'fuel_type': 'petrol',
'id': 'f1499872-898d-5e91-9925-3deb07d833c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ10967',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 11924,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-26',
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2023}
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ10967%27 HTTP/1.1" 200 None
2026-03-30 13:16:45 [auto1.fr] INFO: Saving data for HZ10967: {'auction_closing_time': 1774886132.0, 'created_time': 1773761693.598158, 'last_price_update_time': 1774876605.929729}
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HZ10967') HTTP/1.1" 204 0
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ72764%27 HTTP/1.1" 200 None
2026-03-30 13:16:46 [auto1.fr] INFO: Scrape type for CJ72764: 2
2026-03-30 13:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with identifier: CJ72764
2026-03-30 13:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with scrape type 2
2026-03-30 13:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with scrape type 2
2026-03-30 13:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 819e7ab8-554e-55b7-b1ef-0d08881dbcbd, identifier: CJ72764
2026-03-30 13:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with identifier: CJ72764
2026-03-30 13:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with identifier: CJ72764
2026-03-30 13:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 819e7ab8-554e-55b7-b1ef-0d08881dbcbd with identifier: CJ72764 to the API
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:56:03Z',
'fuel_type': 'diesel',
'id': '819e7ab8-554e-55b7-b1ef-0d08881dbcbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ72764',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 98264,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-25',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 d T BlueTEC',
'transmission': 'automatic',
'trim': 'T BlueTEC',
'year': 2019}
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ72764%27 HTTP/1.1" 200 None
2026-03-30 13:16:46 [auto1.fr] INFO: Saving data for CJ72764: {'auction_closing_time': 1774886163.0, 'created_time': 1774696881.401266, 'last_price_update_time': 1774876606.436619}
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ72764') HTTP/1.1" 204 0
2026-03-30 13:16:46 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ17638%27 HTTP/1.1" 200 None
2026-03-30 13:16:46 [auto1.fr] INFO: Scrape type for HZ17638: 2
2026-03-30 13:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with identifier: HZ17638
2026-03-30 13:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with scrape type 2
2026-03-30 13:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with scrape type 2
2026-03-30 13:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b6ddf4d-1869-5327-a41e-742bbbd313d9, identifier: HZ17638
2026-03-30 13:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with identifier: HZ17638
2026-03-30 13:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with identifier: HZ17638
2026-03-30 13:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b6ddf4d-1869-5327-a41e-742bbbd313d9 with identifier: HZ17638 to the API
2026-03-30 13:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:23Z',
'fuel_type': 'petrol',
'id': '1b6ddf4d-1869-5327-a41e-742bbbd313d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ17638',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 108104,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-11',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ17638%27 HTTP/1.1" 200 None
2026-03-30 13:16:47 [auto1.fr] INFO: Saving data for HZ17638: {'auction_closing_time': 1774884563.0, 'created_time': 1773405830.542812, 'last_price_update_time': 1774876607.633307}
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HZ17638') HTTP/1.1" 204 0
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 13:16:47 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB11677%27 HTTP/1.1" 200 None
2026-03-30 13:16:47 [auto1.fr] INFO: Scrape type for BB11677: 2
2026-03-30 13:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10dd127-d02c-5833-b8ca-6e227e7203d4 with identifier: BB11677
2026-03-30 13:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10dd127-d02c-5833-b8ca-6e227e7203d4 with scrape type 2
2026-03-30 13:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10dd127-d02c-5833-b8ca-6e227e7203d4 with scrape type 2
2026-03-30 13:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f10dd127-d02c-5833-b8ca-6e227e7203d4, identifier: BB11677
2026-03-30 13:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f10dd127-d02c-5833-b8ca-6e227e7203d4 with identifier: BB11677
2026-03-30 13:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f10dd127-d02c-5833-b8ca-6e227e7203d4 with identifier: BB11677
2026-03-30 13:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f10dd127-d02c-5833-b8ca-6e227e7203d4 with identifier: BB11677 to the API
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:27:58Z',
'fuel_type': 'petrol',
'id': 'f10dd127-d02c-5833-b8ca-6e227e7203d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB11677',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 88115,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-27',
'seller_name': None,
'title': 'Fiat 500X 1.0 Turbo Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2020}
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB11677%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Saving data for BB11677: {'auction_closing_time': 1774884478.0, 'created_time': 1774696882.510114, 'last_price_update_time': 1774876608.057224}
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BB11677') HTTP/1.1" 204 0
2026-03-30 13:16:48 [auto1.fr] INFO: Channel: 24h | Page: 146 | totalHits: 5997 | hits on page: 40
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG62006%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Scrape type for WG62006: 2
2026-03-30 13:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with identifier: WG62006
2026-03-30 13:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23b18ef0-791f-5e9c-a331-e0c9e62ae0da, identifier: WG62006
2026-03-30 13:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with identifier: WG62006
2026-03-30 13:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with identifier: WG62006
2026-03-30 13:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23b18ef0-791f-5e9c-a331-e0c9e62ae0da with identifier: WG62006 to the API
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:28:20Z',
'fuel_type': 'petrol',
'id': '23b18ef0-791f-5e9c-a331-e0c9e62ae0da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG62006',
'listing': 'auction',
'make': 'Peugeot',
'model': '408',
'odometer': 10911,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-28',
'seller_name': None,
'title': 'Peugeot 408 1.2 Mild-Hybrid Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2024}
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG62006%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Saving data for WG62006: {'auction_closing_time': 1774884500.0, 'created_time': 1774696908.572068, 'last_price_update_time': 1774876608.520638}
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG62006') HTTP/1.1" 204 0
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD94932%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Scrape type for LD94932: 2
2026-03-30 13:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932
2026-03-30 13:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fa04dd-44da-52ee-abc6-e7483a47ef7d with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fa04dd-44da-52ee-abc6-e7483a47ef7d with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8fa04dd-44da-52ee-abc6-e7483a47ef7d, identifier: LD94932
2026-03-30 13:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 13:16:48 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD94932%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Scrape type for LD94932: 2
2026-03-30 13:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fa04dd-44da-52ee-abc6-e7483a47ef7d with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fa04dd-44da-52ee-abc6-e7483a47ef7d with scrape type 2
2026-03-30 13:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8fa04dd-44da-52ee-abc6-e7483a47ef7d, identifier: LD94932
2026-03-30 13:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932
2026-03-30 13:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932
2026-03-30 13:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932 to the API
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': 'e8fa04dd-44da-52ee-abc6-e7483a47ef7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD94932',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 238342,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Avus',
'transmission': 'automatic',
'trim': 'quattro Avus',
'year': 2012}
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD94932%27 HTTP/1.1" 200 None
2026-03-30 13:16:48 [auto1.fr] INFO: Saving data for LD94932: {'auction_closing_time': 1774885528.0, 'created_time': 1774696903.338204, 'last_price_update_time': 1774876608.996925}
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LD94932') HTTP/1.1" 204 0
2026-03-30 13:16:49 [scrapy.extensions.logstats] INFO: Crawled 402 pages (at 17 pages/min), scraped 302 items (at 71 items/min)
2026-03-30 13:16:49 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932
2026-03-30 13:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932
2026-03-30 13:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8fa04dd-44da-52ee-abc6-e7483a47ef7d with identifier: LD94932 to the API
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': 'e8fa04dd-44da-52ee-abc6-e7483a47ef7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD94932',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 238342,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Avus',
'transmission': 'automatic',
'trim': 'quattro Avus',
'year': 2012}
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD94932%27 HTTP/1.1" 200 None
2026-03-30 13:16:49 [auto1.fr] INFO: Saving data for LD94932: {'auction_closing_time': 1774885528.0, 'created_time': 1774696903.338204, 'last_price_update_time': 1774876609.256871}
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LD94932') HTTP/1.1" 204 0
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB62030%27 HTTP/1.1" 200 None
2026-03-30 13:16:49 [auto1.fr] INFO: Scrape type for AB62030: 2
2026-03-30 13:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 191a1540-dc64-5d51-85b6-0febf1b78390 with identifier: AB62030
2026-03-30 13:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 191a1540-dc64-5d51-85b6-0febf1b78390 with scrape type 2
2026-03-30 13:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 191a1540-dc64-5d51-85b6-0febf1b78390 with scrape type 2
2026-03-30 13:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 191a1540-dc64-5d51-85b6-0febf1b78390, identifier: AB62030
2026-03-30 13:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 191a1540-dc64-5d51-85b6-0febf1b78390 with identifier: AB62030
2026-03-30 13:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 191a1540-dc64-5d51-85b6-0febf1b78390 with identifier: AB62030
2026-03-30 13:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 191a1540-dc64-5d51-85b6-0febf1b78390 with identifier: AB62030 to the API
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'diesel',
'id': '191a1540-dc64-5d51-85b6-0febf1b78390',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB62030',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 220044,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-09',
'seller_name': None,
'title': 'Peugeot 5008 1.6 e-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2013}
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB62030%27 HTTP/1.1" 200 None
2026-03-30 13:16:49 [auto1.fr] INFO: Saving data for AB62030: {'auction_closing_time': 1774883426.0, 'created_time': 1774696911.355867, 'last_price_update_time': 1774876609.67324}
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB62030') HTTP/1.1" 204 0
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 13:16:49 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ17655%27 HTTP/1.1" 200 None
2026-03-30 13:16:49 [auto1.fr] INFO: Scrape type for PZ17655: 2
2026-03-30 13:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b95970-0e48-5438-bfe1-90a451d58fb7 with identifier: PZ17655
2026-03-30 13:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b95970-0e48-5438-bfe1-90a451d58fb7 with scrape type 2
2026-03-30 13:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0b95970-0e48-5438-bfe1-90a451d58fb7 with scrape type 2
2026-03-30 13:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0b95970-0e48-5438-bfe1-90a451d58fb7, identifier: PZ17655
2026-03-30 13:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0b95970-0e48-5438-bfe1-90a451d58fb7 with identifier: PZ17655
2026-03-30 13:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0b95970-0e48-5438-bfe1-90a451d58fb7 with identifier: PZ17655
2026-03-30 13:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0b95970-0e48-5438-bfe1-90a451d58fb7 with identifier: PZ17655 to the API
2026-03-30 13:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:13:33Z',
'fuel_type': 'diesel',
'id': 'e0b95970-0e48-5438-bfe1-90a451d58fb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ17655',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 370759,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-20',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2010}
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ17655%27 HTTP/1.1" 200 None
2026-03-30 13:16:50 [auto1.fr] INFO: Saving data for PZ17655: {'auction_closing_time': 1774883613.0, 'created_time': 1774696891.517708, 'last_price_update_time': 1774876610.23019}
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ17655') HTTP/1.1" 204 0
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX31357%27 HTTP/1.1" 200 None
2026-03-30 13:16:50 [auto1.fr] INFO: Scrape type for SX31357: 0
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE22232%27 HTTP/1.1" 200 None
2026-03-30 13:16:50 [auto1.fr] INFO: Scrape type for UE22232: 2
2026-03-30 13:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c974be-78db-5aa8-b987-34ef7dccaad3 with identifier: UE22232
2026-03-30 13:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c974be-78db-5aa8-b987-34ef7dccaad3 with scrape type 2
2026-03-30 13:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c974be-78db-5aa8-b987-34ef7dccaad3 with scrape type 2
2026-03-30 13:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0c974be-78db-5aa8-b987-34ef7dccaad3, identifier: UE22232
2026-03-30 13:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0c974be-78db-5aa8-b987-34ef7dccaad3 with identifier: UE22232
2026-03-30 13:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0c974be-78db-5aa8-b987-34ef7dccaad3 with identifier: UE22232
2026-03-30 13:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0c974be-78db-5aa8-b987-34ef7dccaad3 with identifier: UE22232 to the API
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:26:30Z',
'fuel_type': 'diesel',
'id': 'd0c974be-78db-5aa8-b987-34ef7dccaad3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE22232',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 225242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-17',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Cup BlueMotion',
'transmission': 'automatic',
'trim': 'Cup BlueMotion',
'year': 2015}
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE22232%27 HTTP/1.1" 200 None
2026-03-30 13:16:50 [auto1.fr] INFO: Saving data for UE22232: {'auction_closing_time': 1774884390.0, 'created_time': 1774696880.722095, 'last_price_update_time': 1774876610.7193}
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE22232') HTTP/1.1" 204 0
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 13:16:50 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM97397%27 HTTP/1.1" 200 None
2026-03-30 13:16:50 [auto1.fr] INFO: Scrape type for CM97397: 2
2026-03-30 13:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with identifier: CM97397
2026-03-30 13:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with scrape type 2
2026-03-30 13:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with scrape type 2
2026-03-30 13:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4df36ee0-bd51-539d-b4fe-02b98ea5b717, identifier: CM97397
2026-03-30 13:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with identifier: CM97397
2026-03-30 13:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with identifier: CM97397
2026-03-30 13:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4df36ee0-bd51-539d-b4fe-02b98ea5b717 with identifier: CM97397 to the API
2026-03-30 13:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:37:41Z',
'fuel_type': 'petrol',
'id': '4df36ee0-bd51-539d-b4fe-02b98ea5b717',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM97397',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 68412,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'Citroen C1 1.0 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2009}
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM97397%27 HTTP/1.1" 200 None
2026-03-30 13:16:51 [auto1.fr] INFO: Saving data for CM97397: {'auction_closing_time': 1774885061.0, 'created_time': 1774696910.793384, 'last_price_update_time': 1774876611.132335}
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CM97397') HTTP/1.1" 204 0
2026-03-30 13:16:51 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 13:16:51 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 13:16:51 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA62794%27 HTTP/1.1" 200 None
2026-03-30 13:16:51 [auto1.fr] INFO: Scrape type for DA62794: 2
2026-03-30 13:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with identifier: DA62794
2026-03-30 13:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with scrape type 2
2026-03-30 13:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with scrape type 2
2026-03-30 13:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed, identifier: DA62794
2026-03-30 13:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with identifier: DA62794
2026-03-30 13:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with identifier: DA62794
2026-03-30 13:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d6dc3e41-aeb2-51b5-976b-2d7c15ee69ed with identifier: DA62794 to the API
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:57:23Z',
'fuel_type': 'petrol',
'id': 'd6dc3e41-aeb2-51b5-976b-2d7c15ee69ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA62794',
'listing': 'auction',
'make': 'Renault',
'model': 'Arkana',
'odometer': 74841,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-27',
'seller_name': None,
'title': 'Renault Arkana 1.3 TCe Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2022}
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA62794%27 HTTP/1.1" 200 None
2026-03-30 13:16:51 [auto1.fr] INFO: Saving data for DA62794: {'auction_closing_time': 1774886243.0, 'created_time': 1773940559.90063, 'last_price_update_time': 1774876611.61278}
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA62794') HTTP/1.1" 204 0
2026-03-30 13:16:51 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM36705%27 HTTP/1.1" 200 None
2026-03-30 13:16:51 [auto1.fr] INFO: Scrape type for CM36705: 2
2026-03-30 13:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98ce512-0a5f-542b-98a5-a830014845e5 with identifier: CM36705
2026-03-30 13:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98ce512-0a5f-542b-98a5-a830014845e5 with scrape type 2
2026-03-30 13:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98ce512-0a5f-542b-98a5-a830014845e5 with scrape type 2
2026-03-30 13:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e98ce512-0a5f-542b-98a5-a830014845e5, identifier: CM36705
2026-03-30 13:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e98ce512-0a5f-542b-98a5-a830014845e5 with identifier: CM36705
2026-03-30 13:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e98ce512-0a5f-542b-98a5-a830014845e5 with identifier: CM36705
2026-03-30 13:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e98ce512-0a5f-542b-98a5-a830014845e5 with identifier: CM36705 to the API
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:44:57Z',
'fuel_type': 'petrol',
'id': 'e98ce512-0a5f-542b-98a5-a830014845e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM36705',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 92173,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-14',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM36705%27 HTTP/1.1" 200 None
2026-03-30 13:16:51 [auto1.fr] INFO: Saving data for CM36705: {'auction_closing_time': 1774885497.0, 'created_time': 1774696905.166568, 'last_price_update_time': 1774876611.994271}
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CM36705') HTTP/1.1" 204 0
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP86638%27 HTTP/1.1" 200 None
2026-03-30 13:16:52 [auto1.fr] INFO: Scrape type for AP86638: 2
2026-03-30 13:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb383ae8-c33c-5bc2-9e15-58793a8e3449 with identifier: AP86638
2026-03-30 13:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb383ae8-c33c-5bc2-9e15-58793a8e3449 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb383ae8-c33c-5bc2-9e15-58793a8e3449 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb383ae8-c33c-5bc2-9e15-58793a8e3449, identifier: AP86638
2026-03-30 13:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb383ae8-c33c-5bc2-9e15-58793a8e3449 with identifier: AP86638
2026-03-30 13:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb383ae8-c33c-5bc2-9e15-58793a8e3449 with identifier: AP86638
2026-03-30 13:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb383ae8-c33c-5bc2-9e15-58793a8e3449 with identifier: AP86638 to the API
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:36:51Z',
'fuel_type': 'diesel',
'id': 'cb383ae8-c33c-5bc2-9e15-58793a8e3449',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP86638',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 169023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Acenta',
'transmission': 'automatic',
'trim': 'Acenta',
'year': 2020}
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP86638%27 HTTP/1.1" 200 None
2026-03-30 13:16:52 [auto1.fr] INFO: Saving data for AP86638: {'auction_closing_time': 1774885011.0, 'created_time': 1774696899.449639, 'last_price_update_time': 1774876612.367801}
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AP86638') HTTP/1.1" 204 0
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM48780%27 HTTP/1.1" 200 None
2026-03-30 13:16:52 [auto1.fr] INFO: Scrape type for HM48780: 2
2026-03-30 13:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with identifier: HM48780
2026-03-30 13:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95, identifier: HM48780
2026-03-30 13:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with identifier: HM48780
2026-03-30 13:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with identifier: HM48780
2026-03-30 13:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0fc825a9-a8b3-5ae3-a023-ab1fafb09f95 with identifier: HM48780 to the API
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 215,
'expiration_date': '2026-03-30T15:33:13Z',
'fuel_type': 'diesel',
'id': '0fc825a9-a8b3-5ae3-a023-ab1fafb09f95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM48780',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 299222,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-07',
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Xénium AWD',
'transmission': 'automatic',
'trim': 'Xénium AWD',
'year': 2012}
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM48780%27 HTTP/1.1" 200 None
2026-03-30 13:16:52 [auto1.fr] INFO: Saving data for HM48780: {'auction_closing_time': 1774884793.0, 'created_time': 1774696895.933391, 'last_price_update_time': 1774876612.746885}
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM48780') HTTP/1.1" 204 0
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 13:16:52 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ78333%27 HTTP/1.1" 200 None
2026-03-30 13:16:52 [auto1.fr] INFO: Scrape type for ZJ78333: 2
2026-03-30 13:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9385d079-8278-5708-a19e-33471b222ab6 with identifier: ZJ78333
2026-03-30 13:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9385d079-8278-5708-a19e-33471b222ab6 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9385d079-8278-5708-a19e-33471b222ab6 with scrape type 2
2026-03-30 13:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9385d079-8278-5708-a19e-33471b222ab6, identifier: ZJ78333
2026-03-30 13:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9385d079-8278-5708-a19e-33471b222ab6 with identifier: ZJ78333
2026-03-30 13:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9385d079-8278-5708-a19e-33471b222ab6 with identifier: ZJ78333
2026-03-30 13:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9385d079-8278-5708-a19e-33471b222ab6 with identifier: ZJ78333 to the API
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:53:47Z',
'fuel_type': 'petrol',
'id': '9385d079-8278-5708-a19e-33471b222ab6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ78333',
'listing': 'auction',
'make': 'Peugeot',
'model': '307',
'odometer': 171797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-04',
'seller_name': None,
'title': 'Peugeot 307 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2005}
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ78333%27 HTTP/1.1" 200 None
2026-03-30 13:16:53 [auto1.fr] INFO: Saving data for ZJ78333: {'auction_closing_time': 1774886027.0, 'created_time': 1774696895.109572, 'last_price_update_time': 1774876613.226458}
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZJ78333') HTTP/1.1" 204 0
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 13:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:53 [auto1.fr] INFO: Channel: 24h | Page: 147 | totalHits: 5998 | hits on page: 40
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC04904%27 HTTP/1.1" 200 None
2026-03-30 13:16:53 [auto1.fr] INFO: Scrape type for MC04904: 2
2026-03-30 13:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with identifier: MC04904
2026-03-30 13:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with scrape type 2
2026-03-30 13:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with scrape type 2
2026-03-30 13:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a, identifier: MC04904
2026-03-30 13:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with identifier: MC04904
2026-03-30 13:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with identifier: MC04904
2026-03-30 13:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a with identifier: MC04904 to the API
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:01:37Z',
'fuel_type': 'diesel',
'id': '92bb4bbc-4e84-5ce5-a7b0-6b5808321a5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC04904',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 256643,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-01',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Feline',
'transmission': 'automatic',
'trim': 'Feline',
'year': 2015}
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC04904%27 HTTP/1.1" 200 None
2026-03-30 13:16:53 [auto1.fr] INFO: Saving data for MC04904: {'auction_closing_time': 1774882897.0, 'created_time': 1774696905.561146, 'last_price_update_time': 1774876613.727225}
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC04904') HTTP/1.1" 204 0
2026-03-30 13:16:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 13:16:53 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW49846%27 HTTP/1.1" 200 None
2026-03-30 13:16:53 [auto1.fr] INFO: Scrape type for TW49846: 2
2026-03-30 13:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c77f12d-08fd-5381-ae72-123aa90b26e7 with identifier: TW49846
2026-03-30 13:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c77f12d-08fd-5381-ae72-123aa90b26e7 with scrape type 2
2026-03-30 13:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c77f12d-08fd-5381-ae72-123aa90b26e7 with scrape type 2
2026-03-30 13:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c77f12d-08fd-5381-ae72-123aa90b26e7, identifier: TW49846
2026-03-30 13:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c77f12d-08fd-5381-ae72-123aa90b26e7 with identifier: TW49846
2026-03-30 13:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c77f12d-08fd-5381-ae72-123aa90b26e7 with identifier: TW49846
2026-03-30 13:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c77f12d-08fd-5381-ae72-123aa90b26e7 with identifier: TW49846 to the API
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:07:19Z',
'fuel_type': 'petrol',
'id': '0c77f12d-08fd-5381-ae72-123aa90b26e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW49846',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 49789,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-28',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW49846%27 HTTP/1.1" 200 None
2026-03-30 13:16:54 [auto1.fr] INFO: Saving data for TW49846: {'auction_closing_time': 1774883239.0, 'created_time': 1774696912.467886, 'last_price_update_time': 1774876614.191596}
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW49846') HTTP/1.1" 204 0
2026-03-30 13:16:54 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 13:16:54 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV66962%27 HTTP/1.1" 200 None
2026-03-30 13:16:54 [auto1.fr] INFO: Scrape type for WV66962: 2
2026-03-30 13:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with identifier: WV66962
2026-03-30 13:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with scrape type 2
2026-03-30 13:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with scrape type 2
2026-03-30 13:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf, identifier: WV66962
2026-03-30 13:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with identifier: WV66962
2026-03-30 13:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with identifier: WV66962
2026-03-30 13:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf with identifier: WV66962 to the API
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:36:55Z',
'fuel_type': 'diesel',
'id': 'cb1e6fed-eb7c-5cb8-85fc-5814cc1d08bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV66962',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 171851,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-19',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV66962%27 HTTP/1.1" 200 None
2026-03-30 13:16:54 [auto1.fr] INFO: Saving data for WV66962: {'auction_closing_time': 1774885015.0, 'created_time': 1773940388.744664, 'last_price_update_time': 1774876614.632004}
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV66962') HTTP/1.1" 204 0
2026-03-30 13:16:54 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY14956%27 HTTP/1.1" 200 None
2026-03-30 13:16:54 [auto1.fr] INFO: Scrape type for WY14956: 2
2026-03-30 13:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0d6e418-105d-58f7-82fb-1dfc24ac8415 with identifier: WY14956
2026-03-30 13:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d6e418-105d-58f7-82fb-1dfc24ac8415 with scrape type 2
2026-03-30 13:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0d6e418-105d-58f7-82fb-1dfc24ac8415 with scrape type 2
2026-03-30 13:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0d6e418-105d-58f7-82fb-1dfc24ac8415, identifier: WY14956
2026-03-30 13:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0d6e418-105d-58f7-82fb-1dfc24ac8415 with identifier: WY14956
2026-03-30 13:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0d6e418-105d-58f7-82fb-1dfc24ac8415 with identifier: WY14956
2026-03-30 13:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0d6e418-105d-58f7-82fb-1dfc24ac8415 with identifier: WY14956 to the API
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:39:17Z',
'fuel_type': 'diesel',
'id': 'e0d6e418-105d-58f7-82fb-1dfc24ac8415',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY14956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 155703,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-06',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Fascination',
'transmission': 'automatic',
'trim': 'Fascination',
'year': 2016}
2026-03-30 13:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY14956%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Saving data for WY14956: {'auction_closing_time': 1774885157.0, 'created_time': 1774038902.133575, 'last_price_update_time': 1774876615.00637}
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY14956') HTTP/1.1" 204 0
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ16018%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Scrape type for KJ16018: 2
2026-03-30 13:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e347a31-babf-5c46-8b55-e7ea333909a1 with identifier: KJ16018
2026-03-30 13:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e347a31-babf-5c46-8b55-e7ea333909a1 with scrape type 2
2026-03-30 13:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e347a31-babf-5c46-8b55-e7ea333909a1 with scrape type 2
2026-03-30 13:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e347a31-babf-5c46-8b55-e7ea333909a1, identifier: KJ16018
2026-03-30 13:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e347a31-babf-5c46-8b55-e7ea333909a1 with identifier: KJ16018
2026-03-30 13:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e347a31-babf-5c46-8b55-e7ea333909a1 with identifier: KJ16018
2026-03-30 13:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e347a31-babf-5c46-8b55-e7ea333909a1 with identifier: KJ16018 to the API
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:32:42Z',
'fuel_type': 'diesel',
'id': '7e347a31-babf-5c46-8b55-e7ea333909a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ16018',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 165598,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-29',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2016}
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ16018%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Saving data for KJ16018: {'auction_closing_time': 1774884762.0, 'created_time': 1774696914.65828, 'last_price_update_time': 1774876615.376932}
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ16018') HTTP/1.1" 204 0
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU61885%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Scrape type for HU61885: 2
2026-03-30 13:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c473968-0146-5af2-8522-b1638d62c014 with identifier: HU61885
2026-03-30 13:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c473968-0146-5af2-8522-b1638d62c014 with scrape type 2
2026-03-30 13:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c473968-0146-5af2-8522-b1638d62c014 with scrape type 2
2026-03-30 13:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c473968-0146-5af2-8522-b1638d62c014, identifier: HU61885
2026-03-30 13:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c473968-0146-5af2-8522-b1638d62c014 with identifier: HU61885
2026-03-30 13:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c473968-0146-5af2-8522-b1638d62c014 with identifier: HU61885
2026-03-30 13:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c473968-0146-5af2-8522-b1638d62c014 with identifier: HU61885 to the API
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:52:53Z',
'fuel_type': 'diesel',
'id': '0c473968-0146-5af2-8522-b1638d62c014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU61885',
'listing': 'auction',
'make': 'Nissan',
'model': 'Navara Pick-up',
'odometer': 145322,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-02',
'seller_name': None,
'title': 'Nissan Navara Pick-up 2.5 dCi King Cab SE 4x4',
'transmission': 'manual',
'trim': 'King Cab SE 4x4',
'year': 2015}
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU61885%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Saving data for HU61885: {'auction_closing_time': 1774885973.0, 'created_time': 1774696918.997827, 'last_price_update_time': 1774876615.927792}
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HU61885') HTTP/1.1" 204 0
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 13:16:55 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC40190%27 HTTP/1.1" 200 None
2026-03-30 13:16:55 [auto1.fr] INFO: Scrape type for FC40190: 2
2026-03-30 13:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with identifier: FC40190
2026-03-30 13:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with scrape type 2
2026-03-30 13:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with scrape type 2
2026-03-30 13:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a2ca46c-aa19-5443-9e64-8a93a98a7058, identifier: FC40190
2026-03-30 13:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with identifier: FC40190
2026-03-30 13:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with identifier: FC40190
2026-03-30 13:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a2ca46c-aa19-5443-9e64-8a93a98a7058 with identifier: FC40190 to the API
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:05:18Z',
'fuel_type': 'petrol',
'id': '7a2ca46c-aa19-5443-9e64-8a93a98a7058',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC40190',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 215523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2009}
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC40190%27 HTTP/1.1" 200 None
2026-03-30 13:16:56 [auto1.fr] INFO: Saving data for FC40190: {'auction_closing_time': 1774883118.0, 'created_time': 1774696919.411045, 'last_price_update_time': 1774876616.31767}
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC40190') HTTP/1.1" 204 0
2026-03-30 13:16:56 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW32282%27 HTTP/1.1" 200 None
2026-03-30 13:16:56 [auto1.fr] INFO: Scrape type for BW32282: 2
2026-03-30 13:16:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with identifier: BW32282
2026-03-30 13:16:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with scrape type 2
2026-03-30 13:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with scrape type 2
2026-03-30 13:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b514792-c5f1-5f6d-af29-ee87e25a20b1, identifier: BW32282
2026-03-30 13:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with identifier: BW32282
2026-03-30 13:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with identifier: BW32282
2026-03-30 13:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b514792-c5f1-5f6d-af29-ee87e25a20b1 with identifier: BW32282 to the API
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:53:26Z',
'fuel_type': 'petrol',
'id': '8b514792-c5f1-5f6d-af29-ee87e25a20b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW32282',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 145050,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-18',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW32282%27 HTTP/1.1" 200 None
2026-03-30 13:16:56 [auto1.fr] INFO: Saving data for BW32282: {'auction_closing_time': 1774886006.0, 'created_time': 1774452329.823008, 'last_price_update_time': 1774876616.688006}
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BW32282') HTTP/1.1" 204 0
2026-03-30 13:16:56 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 13:16:56 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ20525%27 HTTP/1.1" 200 None
2026-03-30 13:16:56 [auto1.fr] INFO: Scrape type for TZ20525: 2
2026-03-30 13:16:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53aec07-2dab-5f01-849a-258c8e7d2529 with identifier: TZ20525
2026-03-30 13:16:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53aec07-2dab-5f01-849a-258c8e7d2529 with scrape type 2
2026-03-30 13:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53aec07-2dab-5f01-849a-258c8e7d2529 with scrape type 2
2026-03-30 13:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e53aec07-2dab-5f01-849a-258c8e7d2529, identifier: TZ20525
2026-03-30 13:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e53aec07-2dab-5f01-849a-258c8e7d2529 with identifier: TZ20525
2026-03-30 13:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e53aec07-2dab-5f01-849a-258c8e7d2529 with identifier: TZ20525
2026-03-30 13:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e53aec07-2dab-5f01-849a-258c8e7d2529 with identifier: TZ20525 to the API
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:49:39Z',
'fuel_type': 'diesel',
'id': 'e53aec07-2dab-5f01-849a-258c8e7d2529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ20525',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 231564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-12',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ20525%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Saving data for TZ20525: {'auction_closing_time': 1774885779.0, 'created_time': 1774696914.10902, 'last_price_update_time': 1774876617.077354}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ20525') HTTP/1.1" 204 0
2026-03-30 13:16:57 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL68366%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Scrape type for PL68366: 2
2026-03-30 13:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37836617-f8f5-5d2f-8e39-85aff39ea559 with identifier: PL68366
2026-03-30 13:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37836617-f8f5-5d2f-8e39-85aff39ea559 with scrape type 2
2026-03-30 13:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37836617-f8f5-5d2f-8e39-85aff39ea559 with scrape type 2
2026-03-30 13:16:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 37836617-f8f5-5d2f-8e39-85aff39ea559, identifier: PL68366
2026-03-30 13:16:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 37836617-f8f5-5d2f-8e39-85aff39ea559 with identifier: PL68366
2026-03-30 13:16:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 37836617-f8f5-5d2f-8e39-85aff39ea559 with identifier: PL68366
2026-03-30 13:16:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 37836617-f8f5-5d2f-8e39-85aff39ea559 with identifier: PL68366 to the API
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:32:00Z',
'fuel_type': 'petrol',
'id': '37836617-f8f5-5d2f-8e39-85aff39ea559',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL68366',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 80403,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-05',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL68366%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Saving data for PL68366: {'auction_closing_time': 1774884720.0, 'created_time': 1774091880.142243, 'last_price_update_time': 1774876617.465092}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL68366') HTTP/1.1" 204 0
2026-03-30 13:16:57 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE38693%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Scrape type for GE38693: 2
2026-03-30 13:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with identifier: GE38693
2026-03-30 13:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with scrape type 2
2026-03-30 13:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with scrape type 2
2026-03-30 13:16:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563, identifier: GE38693
2026-03-30 13:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:16:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with identifier: GE38693
2026-03-30 13:16:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with identifier: GE38693
2026-03-30 13:16:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563 with identifier: GE38693 to the API
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:33:11Z',
'fuel_type': 'hybrid',
'id': '3f9ccaa2-c2c6-595f-9aa2-b0f2b2e77563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE38693',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 68352,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-19',
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2021}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE38693%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Saving data for GE38693: {'auction_closing_time': 1774884791.0, 'created_time': 1774696922.542861, 'last_price_update_time': 1774876617.882255}
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE38693') HTTP/1.1" 204 0
2026-03-30 13:16:57 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH21450%27 HTTP/1.1" 200 None
2026-03-30 13:16:57 [auto1.fr] INFO: Scrape type for FH21450: 2
2026-03-30 13:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with identifier: FH21450
2026-03-30 13:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with scrape type 2
2026-03-30 13:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with scrape type 2
2026-03-30 13:16:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c, identifier: FH21450
2026-03-30 13:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with identifier: FH21450
2026-03-30 13:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with identifier: FH21450
2026-03-30 13:16:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c with identifier: FH21450 to the API
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:31:08Z',
'fuel_type': 'petrol',
'id': 'f1ba6ed9-3d3e-5dbe-9e36-bec1adfaa82c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH21450',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 78572,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-01',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH21450%27 HTTP/1.1" 200 None
2026-03-30 13:16:58 [auto1.fr] INFO: Saving data for FH21450: {'auction_closing_time': 1774884668.0, 'created_time': 1774696916.592123, 'last_price_update_time': 1774876618.300155}
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH21450') HTTP/1.1" 204 0
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU46785%27 HTTP/1.1" 200 None
2026-03-30 13:16:58 [auto1.fr] INFO: Scrape type for BU46785: 2
2026-03-30 13:16:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with identifier: BU46785
2026-03-30 13:16:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with scrape type 2
2026-03-30 13:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with scrape type 2
2026-03-30 13:16:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e, identifier: BU46785
2026-03-30 13:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with identifier: BU46785
2026-03-30 13:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with identifier: BU46785
2026-03-30 13:16:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e with identifier: BU46785 to the API
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:56Z',
'fuel_type': 'diesel',
'id': 'c284d04b-d3c7-5f8d-8c09-e2bccdc2b58e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU46785',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 186818,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-29',
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Premium Auto Ecole',
'transmission': 'manual',
'trim': 'Premium Auto Ecole',
'year': 2008}
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU46785%27 HTTP/1.1" 200 None
2026-03-30 13:16:58 [auto1.fr] INFO: Saving data for BU46785: {'auction_closing_time': 1774883516.0, 'created_time': 1774696921.267015, 'last_price_update_time': 1774876618.786823}
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU46785') HTTP/1.1" 204 0
2026-03-30 13:16:58 [auto1.fr] INFO: Channel: 24h | Page: 148 | totalHits: 5999 | hits on page: 40
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 13:16:58 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ77973%27 HTTP/1.1" 200 None
2026-03-30 13:16:58 [auto1.fr] INFO: Scrape type for ZZ77973: 2
2026-03-30 13:16:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13763100-5a6c-5653-bed5-ca5eed734e1e with identifier: ZZ77973
2026-03-30 13:16:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13763100-5a6c-5653-bed5-ca5eed734e1e with scrape type 2
2026-03-30 13:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13763100-5a6c-5653-bed5-ca5eed734e1e with scrape type 2
2026-03-30 13:16:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13763100-5a6c-5653-bed5-ca5eed734e1e, identifier: ZZ77973
2026-03-30 13:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13763100-5a6c-5653-bed5-ca5eed734e1e with identifier: ZZ77973
2026-03-30 13:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13763100-5a6c-5653-bed5-ca5eed734e1e with identifier: ZZ77973
2026-03-30 13:16:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13763100-5a6c-5653-bed5-ca5eed734e1e with identifier: ZZ77973 to the API
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:30:38Z',
'fuel_type': 'diesel',
'id': '13763100-5a6c-5653-bed5-ca5eed734e1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ77973',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 215974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-22',
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2014}
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ77973%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Saving data for ZZ77973: {'auction_closing_time': 1774884638.0, 'created_time': 1774696925.210534, 'last_price_update_time': 1774876619.199417}
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZZ77973') HTTP/1.1" 204 0
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ77973%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Scrape type for ZZ77973: 0
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH00431%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Scrape type for EH00431: 2
2026-03-30 13:16:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6bb2190-6546-5598-8cf4-a10051527f16 with identifier: EH00431
2026-03-30 13:16:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6bb2190-6546-5598-8cf4-a10051527f16 with scrape type 2
2026-03-30 13:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6bb2190-6546-5598-8cf4-a10051527f16 with scrape type 2
2026-03-30 13:16:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6bb2190-6546-5598-8cf4-a10051527f16, identifier: EH00431
2026-03-30 13:16:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:16:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6bb2190-6546-5598-8cf4-a10051527f16 with identifier: EH00431
2026-03-30 13:16:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6bb2190-6546-5598-8cf4-a10051527f16 with identifier: EH00431
2026-03-30 13:16:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e6bb2190-6546-5598-8cf4-a10051527f16 with identifier: EH00431 to the API
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:48:28Z',
'fuel_type': 'petrol',
'id': 'e6bb2190-6546-5598-8cf4-a10051527f16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00431',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 98802,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH00431%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Saving data for EH00431: {'auction_closing_time': 1774885708.0, 'created_time': 1774696940.076286, 'last_price_update_time': 1774876619.790933}
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH00431') HTTP/1.1" 204 0
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA79077%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Scrape type for GA79077: 0
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 13:16:59 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK17685%27 HTTP/1.1" 200 None
2026-03-30 13:16:59 [auto1.fr] INFO: Scrape type for RK17685: 2
2026-03-30 13:16:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4def794d-5902-55bd-a72d-d12a1f661c10 with identifier: RK17685
2026-03-30 13:16:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4def794d-5902-55bd-a72d-d12a1f661c10 with scrape type 2
2026-03-30 13:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4def794d-5902-55bd-a72d-d12a1f661c10 with scrape type 2
2026-03-30 13:17:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4def794d-5902-55bd-a72d-d12a1f661c10, identifier: RK17685
2026-03-30 13:17:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4def794d-5902-55bd-a72d-d12a1f661c10 with identifier: RK17685
2026-03-30 13:17:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4def794d-5902-55bd-a72d-d12a1f661c10 with identifier: RK17685
2026-03-30 13:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4def794d-5902-55bd-a72d-d12a1f661c10 with identifier: RK17685 to the API
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:17:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'diesel',
'id': '4def794d-5902-55bd-a72d-d12a1f661c10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK17685',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 146567,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel Pack',
'transmission': 'manual',
'trim': 'Feel Pack',
'year': 2021}
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK17685%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Saving data for RK17685: {'auction_closing_time': 1774884206.0, 'created_time': 1774452358.571592, 'last_price_update_time': 1774876620.3368}
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK17685') HTTP/1.1" 204 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA85826%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Scrape type for UA85826: 2
2026-03-30 13:17:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc570045-207f-5a45-a2dc-35dcb22cf403 with identifier: UA85826
2026-03-30 13:17:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc570045-207f-5a45-a2dc-35dcb22cf403 with scrape type 2
2026-03-30 13:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc570045-207f-5a45-a2dc-35dcb22cf403 with scrape type 2
2026-03-30 13:17:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc570045-207f-5a45-a2dc-35dcb22cf403, identifier: UA85826
2026-03-30 13:17:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc570045-207f-5a45-a2dc-35dcb22cf403 with identifier: UA85826
2026-03-30 13:17:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc570045-207f-5a45-a2dc-35dcb22cf403 with identifier: UA85826
2026-03-30 13:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc570045-207f-5a45-a2dc-35dcb22cf403 with identifier: UA85826 to the API
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:17:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:53Z',
'fuel_type': 'petrol',
'id': 'fc570045-207f-5a45-a2dc-35dcb22cf403',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA85826',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 261166,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-23',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2015}
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA85826%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Saving data for UA85826: {'auction_closing_time': 1774884473.0, 'created_time': 1773908142.076376, 'last_price_update_time': 1774876620.822805}
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA85826') HTTP/1.1" 204 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH16233%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Scrape type for SH16233: 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX43488%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Scrape type for ZX43488: 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP68007%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Scrape type for YP68007: 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR32762%27 HTTP/1.1" 200 None
2026-03-30 13:17:00 [auto1.fr] INFO: Scrape type for VR32762: 0
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 13:17:00 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 13:17:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:17:01 [auto1.fr] INFO: Channel: 24h | Page: 149 | totalHits: 5999 | hits on page: 40
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME66305%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for ME66305: 0
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR61665%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for RR61665: 0
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ06315%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for DJ06315: 0
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE79692%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for KE79692: 0
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW22841%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for RW22841: 0
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 13:17:01 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV53253%27 HTTP/1.1" 200 None
2026-03-30 13:17:01 [auto1.fr] INFO: Scrape type for TV53253: 2
2026-03-30 13:17:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 884d222e-8bbb-55ca-849d-aa27f3a67174 with identifier: TV53253
2026-03-30 13:17:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 884d222e-8bbb-55ca-849d-aa27f3a67174 with scrape type 2
2026-03-30 13:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 884d222e-8bbb-55ca-849d-aa27f3a67174 with scrape type 2
2026-03-30 13:17:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 884d222e-8bbb-55ca-849d-aa27f3a67174, identifier: TV53253
2026-03-30 13:17:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 884d222e-8bbb-55ca-849d-aa27f3a67174 with identifier: TV53253
2026-03-30 13:17:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 884d222e-8bbb-55ca-849d-aa27f3a67174 with identifier: TV53253
2026-03-30 13:17:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 884d222e-8bbb-55ca-849d-aa27f3a67174 with identifier: TV53253 to the API
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:03:57Z',
'fuel_type': 'electro',
'id': '884d222e-8bbb-55ca-849d-aa27f3a67174',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV53253',
'listing': 'auction',
'make': 'Renault',
'model': 'Zoe',
'odometer': 112026,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-21',
'seller_name': None,
'title': 'Renault Zoe electric drive 43 kW Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2017}
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV53253%27 HTTP/1.1" 200 None
2026-03-30 13:17:02 [auto1.fr] INFO: Saving data for TV53253: {'auction_closing_time': 1774883037.0, 'created_time': 1774512942.108251, 'last_price_update_time': 1774876622.233486}
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TV53253') HTTP/1.1" 204 0
2026-03-30 13:17:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ28083%27 HTTP/1.1" 200 None
2026-03-30 13:17:02 [auto1.fr] INFO: Scrape type for VZ28083: 0
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX37625%27 HTTP/1.1" 200 None
2026-03-30 13:17:02 [auto1.fr] INFO: Scrape type for BX37625: 0
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ66833%27 HTTP/1.1" 200 None
2026-03-30 13:17:02 [auto1.fr] INFO: Scrape type for YZ66833: 0
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF63766%27 HTTP/1.1" 200 None
2026-03-30 13:17:02 [auto1.fr] INFO: Scrape type for LF63766: 0
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 13:17:02 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 13:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:17:03 [auto1.fr] INFO: Channel: 24h | Page: 150 | totalHits: 5999 | hits on page: 39
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL85803%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for WL85803: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL38943%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for LL38943: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT09223%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for PT09223: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV79530%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for LV79530: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR86231%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for NR86231: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX61792%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for EX61792: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY01247%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for GY01247: 0
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 13:17:03 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB27977%27 HTTP/1.1" 200 None
2026-03-30 13:17:03 [auto1.fr] INFO: Scrape type for WB27977: 2
2026-03-30 13:17:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799c7443-88b6-589a-a30b-a4cd9921c097 with identifier: WB27977
2026-03-30 13:17:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799c7443-88b6-589a-a30b-a4cd9921c097 with scrape type 2
2026-03-30 13:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 799c7443-88b6-589a-a30b-a4cd9921c097 with scrape type 2
2026-03-30 13:17:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 799c7443-88b6-589a-a30b-a4cd9921c097, identifier: WB27977
2026-03-30 13:17:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 799c7443-88b6-589a-a30b-a4cd9921c097 with identifier: WB27977
2026-03-30 13:17:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 799c7443-88b6-589a-a30b-a4cd9921c097 with identifier: WB27977
2026-03-30 13:17:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 799c7443-88b6-589a-a30b-a4cd9921c097 with identifier: WB27977 to the API
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:17:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:48Z',
'fuel_type': 'diesel',
'id': '799c7443-88b6-589a-a30b-a4cd9921c097',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB27977',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 278018,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-30',
'seller_name': None,
'title': 'Peugeot 508 2.0 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB27977%27 HTTP/1.1" 200 None
2026-03-30 13:17:04 [auto1.fr] INFO: Saving data for WB27977: {'auction_closing_time': 1774884348.0, 'created_time': 1774015443.035487, 'last_price_update_time': 1774876624.308873}
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB27977') HTTP/1.1" 204 0
2026-03-30 13:17:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:17:04 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 13:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:17:06 [auto1.fr] INFO: Channel: 24h | Page: 151 | totalHits: 6000 | hits on page: 0
2026-03-30 13:17:06 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 13:17:06 [auto1.fr] INFO: auto1.fr Batch config: batch 4/4
2026-03-30 13:17:06 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-30 13:17:06 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (331 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_14_2026-03-30T11_15_00.jl
2026-03-30 13:17:06 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1918873,
'downloader/request_count': 997,
'downloader/request_method_count/GET': 842,
'downloader/request_method_count/POST': 155,
'downloader/response_bytes': 153867915,
'downloader/response_count': 997,
'downloader/response_status_count/200': 995,
'downloader/response_status_count/401': 2,
'dupefilter/filtered': 13,
'elapsed_time_seconds': 4577.183033,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 13, 17, 6, 164439, tzinfo=datetime.timezone.utc),
'item_scraped_count': 331,
'log_count/DEBUG': 11839,
'log_count/INFO': 15354,
'log_count/WARNING': 4,
'memusage/max': 188674048,
'memusage/startup': 149991424,
'photo_download_count': 590,
'request_depth_max': 158,
'response_received_count': 407,
'scheduler/dequeued': 997,
'scheduler/dequeued/memory': 997,
'scheduler/enqueued': 997,
'scheduler/enqueued/memory': 997,
'scrape_type/batch_skipped': 4522,
'scrape_type/new': 124,
'scrape_type/price_update': 207,
'scrape_type/skipped': 1173,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 481,
'scrapy-zyte-api/error_ratio': 0.15384615384615385,
'scrapy-zyte-api/errors': 74,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 74,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 12.338662039770007,
'scrapy-zyte-api/mean_response_seconds': 12.405415223232929,
'scrapy-zyte-api/processed': 407,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 407,
'scrapy-zyte-api/request_args/experimental.requestCookies': 406,
'scrapy-zyte-api/request_args/experimental.responseCookies': 407,
'scrapy-zyte-api/request_args/httpRequestBody': 155,
'scrapy-zyte-api/request_args/httpRequestMethod': 155,
'scrapy-zyte-api/request_args/httpResponseBody': 407,
'scrapy-zyte-api/request_args/httpResponseHeaders': 407,
'scrapy-zyte-api/request_args/sessionContext': 407,
'scrapy-zyte-api/request_args/url': 407,
'scrapy-zyte-api/status_codes/0': 74,
'scrapy-zyte-api/status_codes/200': 407,
'scrapy-zyte-api/success': 407,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 6039,
'source/total_available': 6000,
'start_time': datetime.datetime(2026, 3, 30, 12, 0, 48, 981406, tzinfo=datetime.timezone.utc)}
2026-03-30 13:17:06 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 13:17:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fefd0c93050>
2026-03-30 13:17:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fefd0b1a790>